-- Logs begin at Mon 2022-06-20 10:24:38 UTC, end at Mon 2022-06-20 11:34:01 UTC. -- Jun 20 10:55:56.237911 dv-cinder-846146-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 10:55:56.247067 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 10:55:56 2022] *** Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: nodename: dv-cinder-846146-3-iscsi Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: machine: x86_64 Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: clock source: unix Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: pcre jit disabled Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: detected number of CPU cores: 4 Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: current working directory: / Jun 20 10:55:56.249040 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: detected binary path: /usr/bin/uwsgi-core Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: your processes number limit is 47680 Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: your memory page size is 4096 bytes Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: detected max file descriptor number: 2048 Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: lock engine: pthread robust mutexes Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: thunder lock: enabled Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 10:55:56.249640 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 10:55:56.292353 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: Python main interpreter initialized at 0x5577d232a9c0 Jun 20 10:55:56.292353 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: python threads support enabled Jun 20 10:55:56.292353 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: your server socket listen backlog is limited to 100 connections Jun 20 10:55:56.292353 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: your mercy for graceful operations on workers is 90 seconds Jun 20 10:55:56.292703 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 10:55:56.292789 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: *** Operational MODE: preforking *** Jun 20 10:55:56.293029 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: *** uWSGI is running in multiple interpreter mode *** Jun 20 10:55:56.293029 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: spawned uWSGI master process (pid: 103232) Jun 20 10:55:56.293229 dv-cinder-846146-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 10:55:56.294312 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: spawned uWSGI worker 1 (pid: 103233, cores: 1) Jun 20 10:55:56.294312 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: spawned uWSGI worker 2 (pid: 103234, cores: 1) Jun 20 10:55:56.294312 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 10:55:56.939470 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 10:55:56.943826 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 10:55:58.048576 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 10:55:58.048576 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: from cryptography.utils import int_from_bytes Jun 20 10:55:58.049184 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 10:55:58.049184 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: from cryptography.utils import int_from_bytes Jun 20 10:55:58.050396 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 10:55:58.050396 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: from cryptography.utils import int_from_bytes Jun 20 10:55:58.050869 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 10:55:58.050869 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: from cryptography.utils import int_from_bytes Jun 20 10:56:00.486436 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 10:56:00.487038 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 10:56:00.487178 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 10:56:00.487546 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 10:56:00.487799 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 10:56:00.488183 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.488402 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 10:56:00.488849 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.488941 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 10:56:00.489020 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.489098 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.489163 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 10:56:00.489389 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.489497 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 10:56:00.489694 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.489796 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 10:56:00.490038 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.490199 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.490401 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.490535 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.490724 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.490857 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.490952 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491033 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491276 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491428 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491577 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-3-iscsi {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491670 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491892 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.491993 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.492196 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.492295 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.492501 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.492600 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.492809 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.492907 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.493104 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.493206 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.493416 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.493506 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-3-iscsi {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.493837 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.493934 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.494205 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.494339 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.494767 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.494894 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495012 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495121 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495416 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495532 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495703 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.495819 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496033 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496184 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496318 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496488 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496631 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496791 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.496917 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.497098 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.497264 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.497483 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.497681 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.497881 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498064 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-3-iscsi {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498230 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498344 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498487 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498649 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498766 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.498958 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.499114 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.499291 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.499502 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.499658 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.499885 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-3-iscsi {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.500071 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.500263 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.500571 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.500722 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.500870 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501028 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501183 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501306 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501430 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501578 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501708 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501840 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.501972 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502117 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502274 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502415 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502557 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502680 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502802 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.502922 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503049 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503172 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503307 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503437 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503561 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503719 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503841 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.503841 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504079 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504201 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504322 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504442 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504565 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504759 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.504912 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505037 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505157 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505291 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505421 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505553 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505686 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505818 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.505946 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.506124 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.506289 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.506454 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.506595 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.506795 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.506922 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507051 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507182 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507307 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507435 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507564 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507690 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.507876 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508024 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508148 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508267 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508451 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508594 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508727 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.508849 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509061 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509218 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509370 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509495 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509699 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509879 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.509994 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.510226 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.510359 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.510627 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.510777 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.510901 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511031 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511162 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511293 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511475 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511620 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511799 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.511938 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512070 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512275 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512415 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512537 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512668 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512792 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.512969 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.513105 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.513241 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.513437 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.513574 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.513752 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.513881 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514058 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514234 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514389 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514525 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514662 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514784 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.514965 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515104 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515242 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515366 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515559 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515689 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515850 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.515988 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.516140 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.516319 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.516454 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.516586 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.516721 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.516948 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517077 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517208 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517338 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517469 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517602 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517732 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517855 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.517976 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.518175 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.518306 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.518446 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.518571 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.518755 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.518886 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519062 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519202 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519335 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519457 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519643 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519780 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.519959 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520097 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520233 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520356 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520542 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520673 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520824 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.520975 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.521107 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.521230 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.521430 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.521559 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.521736 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.521879 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522001 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522185 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522353 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522490 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522661 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522804 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.522929 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523060 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523252 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523383 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523559 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523700 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523823 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.523943 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.524146 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.524276 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.524407 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.524538 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.524728 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.524858 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.525118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.525248 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.525421 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.525620 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.525745 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.525874 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526004 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526220 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526368 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526501 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526631 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526830 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.526980 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.527180 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.527315 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.527442 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.527564 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.527694 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.527831 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528003 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528141 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528272 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528393 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528589 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528719 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.528895 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529031 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529154 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529274 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529467 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529596 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529750 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.529889 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.530077 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.530236 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.530430 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.530566 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.530729 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.530857 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.531037 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.531165 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.531350 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.531480 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.531642 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 10:56:00.531773 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.531958 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.532086 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.532262 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.532391 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.532582 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.532711 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.532885 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533014 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533190 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533319 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533481 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533611 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533802 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.533932 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.534140 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.534283 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.534468 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.534606 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.534778 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.534917 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535095 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535240 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535389 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535522 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535673 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535807 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.535994 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.536131 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.536310 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.536437 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.536624 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.536751 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.536927 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537066 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537211 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537398 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537523 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537654 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537824 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.537964 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.538171 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.538306 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.538501 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.538630 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.538804 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.538946 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.539102 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.539231 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.539417 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.539547 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.539738 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.539867 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.540065 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.540205 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.540379 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.540508 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.540792 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.540922 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.541104 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.541223 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.541412 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.541551 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.541684 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.541813 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542006 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542188 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542314 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542435 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542653 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542784 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.542964 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.543093 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.543273 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.543412 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.543573 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.543710 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.543897 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544027 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544210 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544349 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544480 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544602 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544805 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.544933 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.545109 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.545248 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.545402 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.545538 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.545700 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.545840 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546011 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546170 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546307 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546432 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546638 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546760 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.546960 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.547092 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.547263 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.547406 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.547607 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.547734 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.547940 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548065 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548187 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548308 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548430 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548553 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.548882 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549017 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549140 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549334 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549474 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549615 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549744 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.549923 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.550053 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.550272 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.550403 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.550573 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.550704 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.550888 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551017 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551150 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551280 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551477 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551607 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551743 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.551866 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552069 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552207 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552368 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552508 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552681 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552809 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.552985 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553124 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553257 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553378 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553587 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553717 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553854 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.553976 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.554214 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.554345 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.554555 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.554686 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.554868 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555008 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555137 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555258 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555465 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555595 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555785 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.555917 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.556094 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.556252 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.556479 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.556609 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.556787 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.556904 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.557128 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.557268 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.557421 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.557581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.557771 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.557895 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558019 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558178 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558314 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558447 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558637 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558767 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.558923 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559055 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559232 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559371 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559533 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559664 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559842 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.559971 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.560126 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.560262 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.560441 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.560571 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.560723 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.560853 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561023 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561155 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561329 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561465 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561621 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561751 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.561951 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562123 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562250 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562372 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562572 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562703 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562864 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.562995 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.563173 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.563304 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.563501 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.563629 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.563791 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.563919 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.564103 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.564238 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.564411 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.564550 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.564703 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.564834 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565030 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565159 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565336 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565475 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565650 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565779 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.565933 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566058 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566265 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566403 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566569 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566693 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566875 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.566999 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.567172 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.567306 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.567481 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.567606 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.567796 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.567913 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.568102 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.568215 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.568419 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.568511 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.568726 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.568826 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569027 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569128 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569328 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569418 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569628 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569720 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.569930 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570022 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570263 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570356 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570567 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570651 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570879 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.570965 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.571183 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.571266 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.571491 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.571576 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.571817 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.571907 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.572465 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.572559 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.572637 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.572713 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.572798 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573019 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573104 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573325 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573410 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573642 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573745 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.573945 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.574037 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.574286 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.574373 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.574591 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.574676 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.574906 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.575225 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.575360 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.575535 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.575672 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.575842 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.575969 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.576149 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.576277 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.576452 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.576661 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.576787 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.577263 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.577390 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.577512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.577699 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.577833 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578040 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578192 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578328 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578451 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578623 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578751 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.578934 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579062 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579236 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579363 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579535 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579684 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579834 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.579998 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.580125 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.580322 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.580458 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.580635 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.580760 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.580942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.581070 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.581256 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.581382 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.581565 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.581691 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.581876 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582003 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582203 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582331 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582514 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582639 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582810 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.582942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.583110 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.583238 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.583406 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.583533 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.583740 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.583865 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584043 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584181 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584340 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584464 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584651 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584791 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.584955 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585079 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585257 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585383 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585558 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585692 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585859 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.585986 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.586271 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.586401 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.586559 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.586702 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.586864 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.586991 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.587166 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.587292 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.587573 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.587726 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.587879 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588090 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588226 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588359 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588493 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588647 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588773 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.588972 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.589125 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.589272 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.589407 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.589579 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.589704 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.589889 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590029 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590240 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590377 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590502 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590624 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590793 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.590920 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.591182 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.591363 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.591490 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.591694 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.591827 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592005 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592148 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592319 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592444 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592635 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592761 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.592951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.593090 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.593275 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.593513 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.593640 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.593848 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.593974 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.594185 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.594330 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.594505 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.594631 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.594802 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.594927 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.595103 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.595237 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.595408 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.595534 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.595708 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.595835 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596008 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596144 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596310 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596445 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596614 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596741 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.596912 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597039 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597211 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597338 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597509 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597644 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597809 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.597937 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.598171 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.598319 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.598452 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.598576 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.598725 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.598868 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599024 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599161 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599328 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599462 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599627 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599762 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.599927 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600055 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600225 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600352 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600526 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600734 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600860 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.600984 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.601113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.601236 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.601427 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.601562 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.601739 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.601866 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602042 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602179 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602378 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602505 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602681 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602808 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.602996 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.603189 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.603365 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.603491 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.603702 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.603824 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.603936 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604056 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604239 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604365 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604543 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604669 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604841 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.604968 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.605146 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.605274 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.605450 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.605584 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.605756 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.605891 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606060 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606242 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606376 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606501 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606674 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606815 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.606973 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.607099 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.607280 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.607404 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.607583 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.607723 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.607883 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608009 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608180 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608387 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608513 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608643 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608765 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.608887 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609057 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609185 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609348 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609478 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609646 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609772 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.609944 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610067 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610272 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610402 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610573 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610698 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610871 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.610998 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.611170 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.611303 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.611478 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.611602 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.611764 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.611889 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612073 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612211 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612375 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612509 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612673 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612805 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.612968 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613092 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613268 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613401 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613564 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613704 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613861 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.613985 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.614186 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.614326 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.614498 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.614638 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.614801 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.614927 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615099 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615224 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615401 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615535 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615697 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615821 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.615998 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.616124 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.616299 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.616427 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.616603 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.616731 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.616902 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617028 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617200 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617326 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617500 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617633 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617798 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.617933 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.618112 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.618243 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.618448 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.618575 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.618832 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619101 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619543 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619639 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619719 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619795 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619881 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.619968 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620064 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620138 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620287 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620428 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620606 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620794 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.620922 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.621097 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.621222 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.621408 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.621535 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.621725 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.621852 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622035 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622182 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622370 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622509 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622684 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622811 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.622988 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.623115 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.623301 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.623441 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.623610 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.623736 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.623919 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624061 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624220 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624359 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624521 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624655 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624835 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.624959 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.625139 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.625273 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.625446 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.625573 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.625754 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.625879 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626059 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626260 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626384 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626505 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626687 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626811 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.626989 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.627129 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.627294 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.627420 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.627596 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.627721 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.627909 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628035 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628210 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628336 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628517 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628617 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628821 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.628962 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.629125 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.629252 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.629428 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.629552 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.629731 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.629857 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630243 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630371 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630494 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630662 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630798 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.630959 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631084 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631267 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631401 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631569 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631693 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631867 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.631993 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.632170 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.632310 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.632470 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.632605 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.632771 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.632895 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633068 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633205 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633386 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633513 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633688 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633814 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.633994 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.634186 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.634429 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.634588 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.634769 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.634881 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635072 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635200 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635386 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635697 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635822 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.635998 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.636124 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.636380 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.636505 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.636694 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.636830 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.636998 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.637123 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.637306 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.637434 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.637606 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.637733 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.637905 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.638029 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.638237 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.638362 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.638558 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.638778 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.638907 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.639013 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.639141 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.639319 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.639439 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.639702 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.639843 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.640018 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.640145 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.640345 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.640462 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.640791 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.640888 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.641099 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.641187 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.641406 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.641706 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.641802 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.642113 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.642211 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.642429 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.642514 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.642750 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.642880 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.643064 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.643410 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.643505 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.643672 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.643853 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.643978 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.644278 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.644456 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.644601 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.644823 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.645036 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.645180 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.645430 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.645579 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.645753 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.645962 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.646116 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.646405 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.646593 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.646778 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.646932 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.647124 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.647294 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.647447 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.647644 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.647946 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.648109 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.648244 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.648483 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.648619 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.648962 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.649139 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.649275 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.649398 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.649511 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.649820 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.649998 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.650220 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.650361 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.650583 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.650700 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.650985 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.651231 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.651410 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.651556 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.651687 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.651820 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.651953 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.652136 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.652279 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.652446 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.652730 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.652865 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.653154 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.653297 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.653434 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.653562 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.653816 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.654005 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.654184 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.654493 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.654662 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.654808 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.654911 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.655133 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.655304 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.655418 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.655714 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.655842 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.656062 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.656262 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.656485 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.656645 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.656773 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.656975 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.657239 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.657376 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.657538 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.657694 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.657822 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.658231 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.658388 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.658516 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.658703 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.658816 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.659024 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.659146 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.659331 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.659460 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.659696 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.659860 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.660063 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.660279 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.660445 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.660722 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.660850 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.661157 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.661317 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.661453 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.661686 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.661823 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.661984 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.662138 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.662302 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.662495 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.662607 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.662901 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.663028 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.663203 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.663320 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.663549 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.663721 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.663887 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.664101 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.664185 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.664456 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.664593 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.664787 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.665096 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.665364 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.665458 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.665813 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.665912 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.666198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.666293 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.666543 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.666692 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.666984 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.667131 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.667211 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.667480 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.667582 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.667799 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.668209 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.668308 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.668391 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.668479 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.668719 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.668857 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.669084 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.669329 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.669534 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.669670 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.669940 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.670050 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.670279 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.670430 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.670823 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.670927 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.671006 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.671187 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.671290 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.671545 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.671703 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.671918 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.672004 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.672152 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.672511 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.672903 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.673015 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.673167 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.673305 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.673523 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.673640 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.673827 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.674075 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.674262 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.674414 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.674503 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.674768 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.674901 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.675126 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.675255 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.675386 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.675652 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.675733 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.676035 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.676293 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.676392 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.676708 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.676845 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.677155 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.677285 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.677369 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.677643 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.677743 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.677941 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.678053 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.678458 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.678562 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.678662 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.678746 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.679222 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.679389 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.679476 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.679645 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.679777 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.679947 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.680062 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.680293 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.680568 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.680737 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.680917 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.681045 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.681312 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.681827 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.682003 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.682298 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.682425 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.682550 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.682658 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.682775 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.683094 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.683231 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.683430 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.683548 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.683857 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.683966 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.684172 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.684273 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.684495 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.684712 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.684883 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.685105 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.685249 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.685416 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.685541 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.685941 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.686324 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.686433 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.686653 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.686753 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.686972 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.687238 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.687337 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.687596 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.687712 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.687994 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.688089 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.688458 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.688631 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.688774 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.688953 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.689104 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.689252 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.689561 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.689655 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.689861 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.689956 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.690215 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.690419 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.690519 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.690805 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.690993 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.691183 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.691290 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.691455 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.691713 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.691976 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.692108 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.692324 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.692502 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.692810 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.692966 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.693094 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.693283 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.693376 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.693615 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.693793 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.693896 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.694216 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.694304 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.694553 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.694713 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.694822 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.695104 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.695203 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.695432 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.695550 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.695764 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.696005 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.696114 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.696362 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.696475 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.696681 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.697077 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.697232 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.697382 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.697513 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.697702 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.697798 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698023 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698137 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698367 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698461 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698671 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698762 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.698974 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699068 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699282 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699367 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699587 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699672 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699888 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.699981 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.700195 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.700279 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.700496 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.700580 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.700803 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.700896 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.701102 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.701186 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.701409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.701493 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.701708 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.702340 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.702435 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.702660 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.702755 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.702976 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.703070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.703301 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.703392 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.703624 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.703708 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.703925 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704018 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704224 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704314 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704539 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704623 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704845 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.704942 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.705148 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.705232 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.705458 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.705540 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.705764 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.705847 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.706068 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.706163 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.706418 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.706503 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.706727 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.706951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.707035 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.707287 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.707371 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.707609 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.707705 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.707944 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.708147 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.708273 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.708501 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.708598 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.708819 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.708903 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.709144 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.709236 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.709463 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.709551 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.709770 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.709854 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.710074 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.710232 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.710410 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.710506 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.710712 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.710797 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711016 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711099 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711321 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711410 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711628 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711712 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.711930 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.712019 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.712232 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.712317 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.712570 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.712705 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.712875 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.713125 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.713354 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.713441 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.713666 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.713752 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.713969 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.714068 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.714326 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.714501 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.714633 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.714819 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.714937 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.715130 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.715245 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.715440 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.715554 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.715752 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.715856 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716057 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716150 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716362 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716446 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716668 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716765 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.716970 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.717126 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.717278 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.717433 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.717603 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.717740 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.717911 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.718043 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.718235 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.718378 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.718682 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.718774 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.718989 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.719073 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.719299 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.719391 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.719614 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.719706 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.719921 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720014 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720222 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720304 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720541 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720639 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720842 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.720933 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.721157 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.721241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.721461 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.721624 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.721777 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.721862 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.722126 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.722238 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.722453 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.722564 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.722767 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.722988 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.723080 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.723326 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.723428 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.723699 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.723842 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.724155 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.724249 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.724471 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.724573 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.724774 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.724866 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725072 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725164 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725369 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725484 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725671 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725757 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.725970 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726053 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726296 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726382 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726594 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726686 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726893 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.726978 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.727196 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.727281 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.727493 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.727584 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.727791 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.727889 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.728166 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.728665 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.728754 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.728832 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.728908 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.728995 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729081 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729213 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729323 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729521 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729605 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729832 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.729917 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.730165 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.730255 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.730503 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.730586 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.730800 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.730893 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.731120 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.731203 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.731433 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.731526 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.731741 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.731824 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732052 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732135 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732356 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732447 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732661 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732743 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.732962 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733062 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733272 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733363 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733585 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733668 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733889 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.733978 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.734214 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.734311 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.734546 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.734630 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.734850 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.734942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.735157 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.735250 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.735465 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.735557 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.735773 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.735856 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.736076 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.736161 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.736382 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.736512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.736703 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.736788 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737022 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737107 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737323 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737407 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737641 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737735 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.737954 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738039 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738293 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738381 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738604 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738701 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738905 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.738989 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.739206 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.739297 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.739507 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.739599 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.739810 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.739889 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.740118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.740212 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.740423 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.740507 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.740723 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.740807 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741021 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741105 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741325 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741409 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741623 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741702 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.741928 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742011 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742253 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742342 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742555 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742640 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742863 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.742946 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.743162 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.743247 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.743463 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.743552 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.743792 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744063 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744400 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744479 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744566 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744644 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744731 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744843 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.744958 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.745148 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.745260 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.745388 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 10:56:00.745561 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.745859 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.746186 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.746484 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.746809 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.747142 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.747456 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.747777 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.748085 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.748402 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.748707 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.749023 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.749341 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.749655 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.749963 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.750319 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.750629 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.750940 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.751248 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.751555 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.751866 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.752173 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.752496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.752820 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.753123 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.753443 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.753758 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.754075 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.754409 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.754718 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.755044 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.755353 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.755658 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.755970 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.756279 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.756587 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.756899 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.757211 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.757533 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.757852 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.758183 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.758506 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.758829 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.759173 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.759562 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.759987 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.760318 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.760633 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.760944 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.761244 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 10:56:00.761486 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 10:56:00.901808 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO dbcounter [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Registered counter for database nova_api Jun 20 10:56:00.917572 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO dbcounter [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Registered counter for database nova_api Jun 20 10:56:00.922602 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:00.929630 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writer thread running {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:00.938024 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_db.sqlalchemy.engines [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:00.945377 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writer thread running {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:00.987554 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.context [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8d171c-705f-4ce5-ac91-b59b7b5effe3(cell1) {{(pid=103234) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 10:56:00.991471 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 10:56:00.993055 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 10:56:00.993969 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 10:56:00.995956 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 10:56:00.997936 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO dbcounter [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Registered counter for database nova_cell0 Jun 20 10:56:01.001955 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO dbcounter [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Registered counter for database nova_cell1 Jun 20 10:56:01.004337 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.context [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8d171c-705f-4ce5-ac91-b59b7b5effe3(cell1) {{(pid=103233) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 10:56:01.008425 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_concurrency.lockutils [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 10:56:01.009882 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:01.010112 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_concurrency.lockutils [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 10:56:01.010949 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_concurrency.lockutils [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 10:56:01.011501 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:01.012967 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_concurrency.lockutils [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 10:56:01.015042 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO dbcounter [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Registered counter for database nova_cell0 Jun 20 10:56:01.016577 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writer thread running {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:01.019448 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO dbcounter [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Registered counter for database nova_cell1 Jun 20 10:56:01.026769 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_db.sqlalchemy.engines [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:01.028096 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_db.sqlalchemy.engines [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:01.034423 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writer thread running {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:01.036245 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writer thread running {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:01.154123 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writer thread running {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:01.164124 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO dbcounter [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Registered counter for database nova_cell0 Jun 20 10:56:01.171545 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:01.176690 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writer thread running {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:01.183561 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO dbcounter [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Registered counter for database nova_cell0 Jun 20 10:56:01.190341 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG oslo_db.sqlalchemy.engines [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 10:56:01.195180 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writer thread running {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 10:56:01.509466 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 10:56:01.514500 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: WARNING keystonemiddleware.auth_token [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 10:56:01.516662 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 10:56:01.521790 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: WARNING keystonemiddleware.auth_token [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 10:56:01.859124 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 10:56:01.865110 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: WARNING keystonemiddleware.auth_token [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 10:56:01.870626 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5577d232a9c0 pid: 103234 (default app) Jun 20 10:56:01.872703 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:56:01.873873 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Jun 20 10:56:01.874301 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Jun 20 10:56:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:56:01.876454 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: WARNING keystonemiddleware.auth_token [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 10:56:01.882401 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: WARNING keystonemiddleware.auth_token [None req-fdaaa10e-44fc-4729-8509-243bfc3fe6ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 10:56:01.888235 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5577d232a9c0 pid: 103233 (default app) Jun 20 10:57:17.410757 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:17.411761 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 20 10:57:17.412136 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:17.429235 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writing DB stats nova_api:SELECT=3 {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:17.430508 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writing DB stats nova_cell0:SELECT=3 {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:17.431536 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writing DB stats nova_cell1:SELECT=3 {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:17.432250 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writing DB stats nova_cell0:SELECT=3 {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:17.876711 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1b1c78c8-e60a-4691-a2e9-846d128d457a admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:17.910407 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1b1c78c8-e60a-4691-a2e9-846d128d457a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490828 Jun 20 10:57:17.918188 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 20 10:57:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:19.994670 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:19.995674 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-dfc553bd-ba7a-4368-adad-dcd6ba403f6e None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 20 10:57:19.997558 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:20.057151 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-d0657a2e-68a7-4129-a821-d22b3aeec4a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:20.076231 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 10:57:20.076231 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: warnings.warn(msg) Jun 20 10:57:20.108487 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-d0657a2e-68a7-4129-a821-d22b3aeec4a3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106228 Jun 20 10:57:20.109055 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:57:20.125221 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_api:SELECT=3 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:20.126194 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_cell0:SELECT=3 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:20.127524 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_cell1:SELECT=3 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:20.128790 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:57:20.340799 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-459825f7-2cba-46c6-a1c3-18a617beeed5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:20.343277 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 10:57:20.343277 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: warnings.warn(msg) Jun 20 10:57:20.417108 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-459825f7-2cba-46c6-a1c3-18a617beeed5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299152 Jun 20 10:57:20.430182 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 20 10:57:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:22.543168 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-d0657a2e-68a7-4129-a821-d22b3aeec4a3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:22.544228 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-d0657a2e-68a7-4129-a821-d22b3aeec4a3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 20 10:57:22.544616 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:22.679049 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-74443d16-9cc6-4509-b5b3-b97854fee2dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "vcpus": 1, "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:22.697273 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 10:57:22.697273 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: warnings.warn(msg) Jun 20 10:57:22.716719 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-74443d16-9cc6-4509-b5b3-b97854fee2dc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165920 Jun 20 10:57:22.718229 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:57:22.729238 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-7442d1cc-3f09-4903-8082-98bd771a62c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:22.730789 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 10:57:22.730789 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: warnings.warn(msg) Jun 20 10:57:22.775214 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-7442d1cc-3f09-4903-8082-98bd771a62c1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049596 Jun 20 10:57:22.776034 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 20 10:57:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 10:57:24.867621 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-74443d16-9cc6-4509-b5b3-b97854fee2dc admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:24.868818 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-74443d16-9cc6-4509-b5b3-b97854fee2dc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 20 10:57:24.869177 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:24.940590 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-7bfe6ec2-ea69-4667-bb75-c62629d8da34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "id": "d2", "vcpus": 1, "name": "ds1G"}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:24.963390 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-7bfe6ec2-ea69-4667-bb75-c62629d8da34 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087073 Jun 20 10:57:24.971147 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:57:24.976189 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f5d13324-fc18-4b4b-b318-d31c572e73bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:25.000293 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f5d13324-fc18-4b4b-b318-d31c572e73bc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027790 Jun 20 10:57:25.000852 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 20 10:57:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:27.065826 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-7bfe6ec2-ea69-4667-bb75-c62629d8da34 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:27.066874 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-7bfe6ec2-ea69-4667-bb75-c62629d8da34 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 20 10:57:27.067258 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:27.128185 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-4f0091da-6b96-4f5f-9648-181764ca18b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "disk": 10, "vcpus": 2}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:27.146860 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-4f0091da-6b96-4f5f-9648-181764ca18b7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073489 Jun 20 10:57:27.147579 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:57:27.159766 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-75733403-e856-42dd-80e6-f2678bbe3591 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:27.183196 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-75733403-e856-42dd-80e6-f2678bbe3591 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027124 Jun 20 10:57:27.183748 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 20 10:57:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:29.281592 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-4f0091da-6b96-4f5f-9648-181764ca18b7 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:29.282731 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-4f0091da-6b96-4f5f-9648-181764ca18b7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jun 20 10:57:29.283190 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:29.357944 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-ce65b6b4-d124-4d3c-89b0-e082515a0113 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "ram": 4096}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:29.380642 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-ce65b6b4-d124-4d3c-89b0-e082515a0113 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091398 Jun 20 10:57:29.381786 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 10:57:29.395058 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-2061d57f-0415-4d9f-8e07-c6513a512653 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:29.426566 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-2061d57f-0415-4d9f-8e07-c6513a512653 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036135 Jun 20 10:57:29.427823 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 20 10:57:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 10:57:31.506409 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-ce65b6b4-d124-4d3c-89b0-e082515a0113 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:31.507432 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-ce65b6b4-d124-4d3c-89b0-e082515a0113 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Jun 20 10:57:31.507803 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:31.576361 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-dedbf664-0ae9-436c-b04c-654f06e06d63 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:31.599759 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-dedbf664-0ae9-436c-b04c-654f06e06d63 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085675 Jun 20 10:57:31.600425 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 20 10:57:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:57:33.763238 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-ce65b6b4-d124-4d3c-89b0-e082515a0113 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:33.764692 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-ce65b6b4-d124-4d3c-89b0-e082515a0113 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Jun 20 10:57:33.765187 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:33.849005 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-02f7ffe6-545d-4413-8183-2595ccf916cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:33.868747 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-02f7ffe6-545d-4413-8183-2595ccf916cc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088630 Jun 20 10:57:33.869327 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 10:57:33.886113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-48b4fc2b-b314-4d76-bf73-0929465ee03d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:33.919342 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-48b4fc2b-b314-4d76-bf73-0929465ee03d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038609 Jun 20 10:57:33.920018 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 20 10:57:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:36.017547 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-02f7ffe6-545d-4413-8183-2595ccf916cc admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:36.019536 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-02f7ffe6-545d-4413-8183-2595ccf916cc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002908 Jun 20 10:57:36.020357 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:36.092040 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-5058c6dc-c133-4761-8a57-7f5d6a6da60b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:36.113542 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-5058c6dc-c133-4761-8a57-7f5d6a6da60b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083775 Jun 20 10:57:36.114490 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 10:57:36.132004 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-86a85493-ef0b-4297-9904-77ecc2851046 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:36.167277 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-86a85493-ef0b-4297-9904-77ecc2851046 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040785 Jun 20 10:57:36.167994 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 20 10:57:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:38.420710 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-5058c6dc-c133-4761-8a57-7f5d6a6da60b admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:38.426105 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-5058c6dc-c133-4761-8a57-7f5d6a6da60b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001843 Jun 20 10:57:38.426105 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:38.503422 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-49667dec-9bf7-445f-9fd6-df641aed2ff4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "vcpus": 2, "disk": 40, "swap": 0}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:38.525230 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-49667dec-9bf7-445f-9fd6-df641aed2ff4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.096096 Jun 20 10:57:38.525815 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:57:38.538731 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-4e862397-2046-4689-8996-5c5db622af67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:38.565249 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-4e862397-2046-4689-8996-5c5db622af67 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030384 Jun 20 10:57:38.565867 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 20 10:57:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 10:57:40.643213 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-49667dec-9bf7-445f-9fd6-df641aed2ff4 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:40.644237 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-49667dec-9bf7-445f-9fd6-df641aed2ff4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 20 10:57:40.644633 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:40.705228 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-2cf00deb-d41f-45bf-a0e9-766f6033a00b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:40.723598 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-2cf00deb-d41f-45bf-a0e9-766f6033a00b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072852 Jun 20 10:57:40.724402 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 10:57:40.736106 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-fd37f93b-176d-419a-9f19-432a04d6f142 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:40.759449 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-fd37f93b-176d-419a-9f19-432a04d6f142 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026853 Jun 20 10:57:40.760225 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 20 10:57:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:57:42.843359 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-2cf00deb-d41f-45bf-a0e9-766f6033a00b admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:57:42.843359 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-2cf00deb-d41f-45bf-a0e9-766f6033a00b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 20 10:57:42.844064 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:57:42.904170 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-5fe8803d-f28f-4d8d-a00f-662475c324fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "vcpus": 8}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:42.926776 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-5fe8803d-f28f-4d8d-a00f-662475c324fc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077051 Jun 20 10:57:42.927481 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 20 10:57:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 10:57:42.943419 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-13224a9d-5c06-49f5-9828-505fa8a21fc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:57:42.969990 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-13224a9d-5c06-49f5-9828-505fa8a21fc4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033767 Jun 20 10:57:42.970974 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 20 10:57:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:58:07.214353 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-5fe8803d-f28f-4d8d-a00f-662475c324fc admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:07.215386 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-5fe8803d-f28f-4d8d-a00f-662475c324fc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 20 10:58:07.215773 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:07.229459 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:58:07.280520 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-dd126ec6-1619-486f-8288-2e2fd262b0b9 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:07.297512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-dd126ec6-1619-486f-8288-2e2fd262b0b9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075219 Jun 20 10:58:07.298040 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 20 10:58:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:58:08.230058 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-5fe8803d-f28f-4d8d-a00f-662475c324fc admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:08.231118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-5fe8803d-f28f-4d8d-a00f-662475c324fc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 20 10:58:08.231510 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:08.481263 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-fcd90901-eced-4701-bb8f-665cac90e0fe admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:08.491188 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.wsgi [None req-fcd90901-eced-4701-bb8f-665cac90e0fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-fcd90901-eced-4701-bb8f-665cac90e0fe admin admin] Request method failure captured: Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Accept: application/json Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Accept-Encoding: gzip, deflate Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Connection: keep-alive Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Content-Length: 0 Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Host: 10.222.0.33 Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Openstack-Api-Version: compute 2.90 Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Openstack-System-Scope: None Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: User-Agent: python-novaclient Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Auth-Token: gAAAAABisFLA4P36TreWIzmnqgXmtglnvIf7YefjS87MUuqkNkdEucq7dDR-rI3Fb11VVQEekGDhLixdzzLkuvy_4MlftrOsgYvShl2askd5ts4bWXUfHuCeI1SGPLfP7Wod_LmFlYShEZbTEyKMgXI0Spo4gKtdNBS46njyGG1j3QxvfuX68gE Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Domain-Id: None Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Domain-Name: None Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Identity-Status: Confirmed Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Is-Admin-Project: True Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Domain-Id: default Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Domain-Name: Default Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Name: admin Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Role: member,reader,admin Jun 20 10:58:08.494518 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Roles: member,reader,admin Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f76a7fac220343628fdd3080ad89317e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant: admin Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant-Name: admin Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User: admin Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Domain-Id: default Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Domain-Name: Default Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Id: 52894fe1eaba4d88aa400c34b4d5791b Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Name: admin Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: method: > Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: exception: Flavor 42 could not be found. Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: action_args: {'id': '42'} Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 10:58:08.496113 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:08.497241 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.498808 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-fcd90901-eced-4701-bb8f-665cac90e0fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 10:58:08.500062 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-fcd90901-eced-4701-bb8f-665cac90e0fe admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.088181 Jun 20 10:58:08.500062 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 20 10:58:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 10:58:08.507405 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-c7d93626-4cd1-4f35-9080-31c32d96762d admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:08.510742 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:58:08.531656 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-c7d93626-4cd1-4f35-9080-31c32d96762d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028909 Jun 20 10:58:08.532229 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 20 10:58:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:58:08.545149 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-5a4e42e7-986c-49e2-8dba-6f243511fce6 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:08.572789 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-5a4e42e7-986c-49e2-8dba-6f243511fce6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031274 Jun 20 10:58:08.573412 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 20 10:58:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:58:08.587210 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-8872558c-298c-4a84-819d-61b2d80f4c12 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:08.597660 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.wsgi [None req-8872558c-298c-4a84-819d-61b2d80f4c12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-8872558c-298c-4a84-819d-61b2d80f4c12 admin admin] Request method failure captured: Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Accept: application/json Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Accept-Encoding: gzip, deflate Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Connection: keep-alive Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Content-Length: 0 Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Host: 10.222.0.33 Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Openstack-Api-Version: compute 2.90 Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Openstack-System-Scope: None Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: User-Agent: python-novaclient Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Auth-Token: gAAAAABisFLA4P36TreWIzmnqgXmtglnvIf7YefjS87MUuqkNkdEucq7dDR-rI3Fb11VVQEekGDhLixdzzLkuvy_4MlftrOsgYvShl2askd5ts4bWXUfHuCeI1SGPLfP7Wod_LmFlYShEZbTEyKMgXI0Spo4gKtdNBS46njyGG1j3QxvfuX68gE Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Domain-Id: None Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Domain-Name: None Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Identity-Status: Confirmed Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Is-Admin-Project: True Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Domain-Id: default Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Domain-Name: Default Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Name: admin Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Role: member,reader,admin Jun 20 10:58:08.603198 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Roles: member,reader,admin Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f76a7fac220343628fdd3080ad89317e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant: admin Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant-Name: admin Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User: admin Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Domain-Id: default Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Domain-Name: Default Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Id: 52894fe1eaba4d88aa400c34b4d5791b Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Name: admin Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: method: > Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: exception: Flavor 42 could not be found. Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: action_args: {'id': '42'} Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 10:58:08.604715 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:08.605642 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:08.607118 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-8872558c-298c-4a84-819d-61b2d80f4c12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 10:58:08.608306 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-8872558c-298c-4a84-819d-61b2d80f4c12 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.023683 Jun 20 10:58:08.608306 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 20 10:58:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 10:58:09.465663 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-5a4e42e7-986c-49e2-8dba-6f243511fce6 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:09.467196 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-5a4e42e7-986c-49e2-8dba-6f243511fce6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jun 20 10:58:09.467678 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:09.673898 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-204c94b4-64cb-4889-af75-465bd322788c admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:09.679721 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.wsgi [None req-204c94b4-64cb-4889-af75-465bd322788c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-204c94b4-64cb-4889-af75-465bd322788c admin admin] Request method failure captured: Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Accept: application/json Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Accept-Encoding: gzip, deflate Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Connection: keep-alive Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Content-Length: 0 Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Host: 10.222.0.33 Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Openstack-Api-Version: compute 2.90 Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Openstack-System-Scope: None Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: User-Agent: python-novaclient Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Auth-Token: gAAAAABisFLBjuBBzajNdjbqhUGaDlSvWLcg3kRP6pW_gXDqyCzAPJ1Pg5ETS2VCDcl0v1DH8xXeSRMD2k-X5gxJvVqC6mDV7tDMiTYxdJRdYcPWxl8ghaoVhk3cgGWM79nxNVH0uZFrRVJ2CnIpe60-Dy3pB_mMXhVdnMtqyQMy81sPYCBJxjw Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Domain-Id: None Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Domain-Name: None Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Identity-Status: Confirmed Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Is-Admin-Project: True Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Domain-Id: default Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Domain-Name: Default Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Name: admin Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Role: member,reader,admin Jun 20 10:58:09.681527 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Roles: member,reader,admin Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f76a7fac220343628fdd3080ad89317e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant: admin Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant-Name: admin Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User: admin Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Domain-Id: default Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Domain-Name: Default Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Id: 52894fe1eaba4d88aa400c34b4d5791b Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Name: admin Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: method: > Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: exception: Flavor 84 could not be found. Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: action_args: {'id': '84'} Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 10:58:09.683031 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:09.683951 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.685409 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-204c94b4-64cb-4889-af75-465bd322788c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 10:58:09.686671 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-204c94b4-64cb-4889-af75-465bd322788c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076525 Jun 20 10:58:09.686671 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 20 10:58:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 10:58:09.693295 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-d5beecb2-3eb0-4692-aff1-62619b1ba6c5 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:09.709315 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-d5beecb2-3eb0-4692-aff1-62619b1ba6c5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019642 Jun 20 10:58:09.709813 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 20 10:58:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:58:09.722255 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-1f1f9092-9df4-44d6-b53c-b0d93bf33b7d admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:09.740491 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-1f1f9092-9df4-44d6-b53c-b0d93bf33b7d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024004 Jun 20 10:58:09.741010 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 20 10:58:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:58:09.750929 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-75a634d5-2a3c-44ef-b1d3-9693de016525 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:09.756396 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.wsgi [None req-75a634d5-2a3c-44ef-b1d3-9693de016525 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-75a634d5-2a3c-44ef-b1d3-9693de016525 admin admin] Request method failure captured: Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Accept: application/json Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Accept-Encoding: gzip, deflate Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Connection: keep-alive Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Content-Length: 0 Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Host: 10.222.0.33 Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Openstack-Api-Version: compute 2.90 Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Openstack-System-Scope: None Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: User-Agent: python-novaclient Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Auth-Token: gAAAAABisFLBjuBBzajNdjbqhUGaDlSvWLcg3kRP6pW_gXDqyCzAPJ1Pg5ETS2VCDcl0v1DH8xXeSRMD2k-X5gxJvVqC6mDV7tDMiTYxdJRdYcPWxl8ghaoVhk3cgGWM79nxNVH0uZFrRVJ2CnIpe60-Dy3pB_mMXhVdnMtqyQMy81sPYCBJxjw Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Domain-Id: None Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Domain-Name: None Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Identity-Status: Confirmed Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Is-Admin-Project: True Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Domain-Id: default Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Domain-Name: Default Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Name: admin Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Role: member,reader,admin Jun 20 10:58:09.757902 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Roles: member,reader,admin Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f76a7fac220343628fdd3080ad89317e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant: admin Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant-Name: admin Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User: admin Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Domain-Id: default Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Domain-Name: Default Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Id: 52894fe1eaba4d88aa400c34b4d5791b Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Name: admin Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: method: > Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: exception: Flavor 84 could not be found. Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: action_args: {'id': '84'} Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 10:58:09.759374 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:09.760282 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:09.761496 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-75a634d5-2a3c-44ef-b1d3-9693de016525 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 10:58:09.762713 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-75a634d5-2a3c-44ef-b1d3-9693de016525 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012225 Jun 20 10:58:09.762713 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 20 10:58:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 10:58:10.598680 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-1f1f9092-9df4-44d6-b53c-b0d93bf33b7d admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:10.599683 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-1f1f9092-9df4-44d6-b53c-b0d93bf33b7d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 20 10:58:10.600065 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:10.799928 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1940aed7-b33e-481d-b4b0-8320bff92289 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:10.806577 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.wsgi [None req-1940aed7-b33e-481d-b4b0-8320bff92289 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1940aed7-b33e-481d-b4b0-8320bff92289 admin admin] Request method failure captured: Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Accept: application/json Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Accept-Encoding: gzip, deflate Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Connection: keep-alive Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Content-Length: 0 Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Host: 10.222.0.33 Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Openstack-Api-Version: compute 2.90 Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Openstack-System-Scope: None Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: User-Agent: python-novaclient Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Auth-Token: gAAAAABisFLCKknxAijT0pH6xW2dNQvteomUwtvG5x6UI07cgr5NgTe3FetwEK402D_2Yw1n8SJzLvCoQ3-5-tiI7usUziRaYvJoScs_W2d18zBhfiBI0JWskEldhsc-oxWPAc3JucYFKlMg3tumZSAQT2_078XpNWzKYZMdAJzjXJxqQM_yZtw Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Domain-Id: None Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Domain-Name: None Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Identity-Status: Confirmed Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Is-Admin-Project: True Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Domain-Id: default Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Domain-Name: Default Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Project-Name: admin Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Role: member,reader,admin Jun 20 10:58:10.808070 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Roles: member,reader,admin Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f76a7fac220343628fdd3080ad89317e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant: admin Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-Tenant-Name: admin Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User: admin Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Domain-Id: default Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Domain-Name: Default Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Id: 52894fe1eaba4d88aa400c34b4d5791b Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: X-User-Name: admin Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: method: > Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: exception: Flavor 451 could not be found. Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: action_args: {'id': '451'} Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 10:58:10.809512 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:10.810385 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.811942 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1940aed7-b33e-481d-b4b0-8320bff92289 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 10:58:10.813596 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1940aed7-b33e-481d-b4b0-8320bff92289 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070465 Jun 20 10:58:10.813596 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 20 10:58:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 10:58:10.821584 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-68a850a8-8bbd-42a3-9ef7-22efa2491978 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:10.835643 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-68a850a8-8bbd-42a3-9ef7-22efa2491978 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017735 Jun 20 10:58:10.836184 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 20 10:58:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 10:58:10.846036 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:10.860094 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017669 Jun 20 10:58:10.860593 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 20 10:58:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:58:10.870190 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f8d60661-8569-4b38-a077-4d45f44baa7c admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:10.875777 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.wsgi [None req-f8d60661-8569-4b38-a077-4d45f44baa7c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f8d60661-8569-4b38-a077-4d45f44baa7c admin admin] Request method failure captured: Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Accept: application/json Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Accept-Encoding: gzip, deflate Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Connection: keep-alive Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Content-Length: 0 Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Host: 10.222.0.33 Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Openstack-Api-Version: compute 2.90 Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Openstack-System-Scope: None Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: User-Agent: python-novaclient Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Auth-Token: gAAAAABisFLCKknxAijT0pH6xW2dNQvteomUwtvG5x6UI07cgr5NgTe3FetwEK402D_2Yw1n8SJzLvCoQ3-5-tiI7usUziRaYvJoScs_W2d18zBhfiBI0JWskEldhsc-oxWPAc3JucYFKlMg3tumZSAQT2_078XpNWzKYZMdAJzjXJxqQM_yZtw Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Domain-Id: None Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Domain-Name: None Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Identity-Status: Confirmed Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Is-Admin-Project: True Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Domain-Id: default Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Domain-Name: Default Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Project-Name: admin Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Role: member,reader,admin Jun 20 10:58:10.877341 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Roles: member,reader,admin Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f76a7fac220343628fdd3080ad89317e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f76a7fac220343628fdd3080ad89317e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant: admin Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant-Id: f76a7fac220343628fdd3080ad89317e Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-Tenant-Name: admin Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User: admin Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Domain-Id: default Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Domain-Name: Default Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Id: 52894fe1eaba4d88aa400c34b4d5791b Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: X-User-Name: admin Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: method: > Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: exception: Flavor 451 could not be found. Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: action_args: {'id': '451'} Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 10:58:10.878744 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:10.880563 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: ERROR nova.api.openstack.wsgi Jun 20 10:58:10.881581 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f8d60661-8569-4b38-a077-4d45f44baa7c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 10:58:10.882606 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f8d60661-8569-4b38-a077-4d45f44baa7c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012296 Jun 20 10:58:10.882606 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 20 10:58:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 10:58:11.702289 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:11.703306 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 20 10:58:11.703702 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:11.912810 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-e63d7e09-622e-4cb9-9c13-752855cc1b57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:58:11.934597 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-e63d7e09-622e-4cb9-9c13-752855cc1b57 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.089669 Jun 20 10:58:11.935218 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 20 10:58:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:58:12.779052 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:12.782011 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jun 20 10:58:12.782462 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:12.978592 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-3d8bfa55-b336-4d9a-812e-8aac15e52af1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:58:13.000424 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-3d8bfa55-b336-4d9a-812e-8aac15e52af1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078723 Jun 20 10:58:13.000878 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 20 10:58:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:58:13.830935 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:13.832285 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 Jun 20 10:58:13.832758 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:14.041288 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-f8b9448d-8f39-4bb4-97f3-7589a14d64c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:58:14.061515 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-f8b9448d-8f39-4bb4-97f3-7589a14d64c8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.090780 Jun 20 10:58:14.062054 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 20 10:58:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:58:14.912095 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:14.913120 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 20 10:58:14.913517 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:15.116589 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-2b7467c4-587d-427f-a0af-2ac903a28583 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 10:58:15.137758 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-2b7467c4-587d-427f-a0af-2ac903a28583 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081825 Jun 20 10:58:15.138368 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 20 10:58:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 10:58:15.950040 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:15.951083 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 Jun 20 10:58:15.951476 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 10:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:58:16.148541 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-517209b5-a9f9-46c4-85f6-494ff4ca5e3e admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:58:16.168740 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-517209b5-a9f9-46c4-85f6-494ff4ca5e3e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079272 Jun 20 10:58:16.169163 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Jun 20 10:58:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:59:02.872478 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:59:02.873498 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-1d53294b-11e1-4681-9245-e71cf02b37e3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 20 10:59:02.873913 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 20 10:59:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 10:59:02.884706 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:59:02.941720 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-bec49bf7-cc3f-4faa-b3af-82a628a4ab77 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:59:02.961350 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-bec49bf7-cc3f-4faa-b3af-82a628a4ab77 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081394 Jun 20 10:59:02.962207 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 20 10:59:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 10:59:02.987383 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-cad2a7a9-cfd5-4d75-8335-a0b024dacf57 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:59:02.990871 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG dbcounter [-] [103233] Writing DB stats nova_api:SELECT=14 {{(pid=103233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 10:59:02.996504 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-cad2a7a9-cfd5-4d75-8335-a0b024dacf57 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013001 Jun 20 10:59:02.997034 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jun 20 10:59:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:59:03.008862 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-fe351899-e651-4b68-b651-2278a820f525 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:59:03.016924 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-fe351899-e651-4b68-b651-2278a820f525 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011703 Jun 20 10:59:03.017424 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jun 20 10:59:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:59:03.029085 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:59:03.037133 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011889 Jun 20 10:59:03.037649 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jun 20 10:59:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 10:59:03.051344 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-38ad22b8-c306-47a3-b415-9cebb587eeda admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 10:59:03.060965 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-38ad22b8-c306-47a3-b415-9cebb587eeda admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015264 Jun 20 10:59:03.061374 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jun 20 10:59:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:02:19.605449 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:19.606509 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 20 11:02:19.606896 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 11:02:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:02:19.746861 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_api:SELECT=6 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:02:19.876643 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-5eda6e90-532e-45fe-91f2-d0d07de8baf8 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:19.877890 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:02:19.877890 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: warnings.warn(msg) Jun 20 11:02:19.879109 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-5eda6e90-532e-45fe-91f2-d0d07de8baf8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:19.879587 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-5eda6e90-532e-45fe-91f2-d0d07de8baf8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:19.880355 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-5eda6e90-532e-45fe-91f2-d0d07de8baf8 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:19.880772 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-5eda6e90-532e-45fe-91f2-d0d07de8baf8 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:19.914424 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-5eda6e90-532e-45fe-91f2-d0d07de8baf8 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.168994 Jun 20 11:02:19.914970 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 20 11:02:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:02:20.761223 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:20.762274 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jun 20 11:02:20.762664 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 11:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:02:20.967000 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-154e2ac5-6805-4e4a-b81b-de621b442343 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:20.968176 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:02:20.968176 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: warnings.warn(msg) Jun 20 11:02:20.969350 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-154e2ac5-6805-4e4a-b81b-de621b442343 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:20.969785 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-154e2ac5-6805-4e4a-b81b-de621b442343 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:20.970788 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-154e2ac5-6805-4e4a-b81b-de621b442343 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:20.971156 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-154e2ac5-6805-4e4a-b81b-de621b442343 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:20.990517 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-154e2ac5-6805-4e4a-b81b-de621b442343 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076842 Jun 20 11:02:20.991020 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 20 11:02:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:02:32.259332 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:32.260334 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 20 11:02:32.260755 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 11:02:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:02:32.407492 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_cell0:SELECT=4 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:02:32.408391 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_cell1:SELECT=4 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:02:32.409034 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG dbcounter [-] [103234] Writing DB stats nova_api:SELECT=8 {{(pid=103234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:02:32.462599 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-1fb13ebb-1040-4323-8fb6-87e5f2b71e35 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:32.463750 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:02:32.463750 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: warnings.warn(msg) Jun 20 11:02:32.464927 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-1fb13ebb-1040-4323-8fb6-87e5f2b71e35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:32.465425 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-1fb13ebb-1040-4323-8fb6-87e5f2b71e35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:32.466143 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-1fb13ebb-1040-4323-8fb6-87e5f2b71e35 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:32.466574 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-1fb13ebb-1040-4323-8fb6-87e5f2b71e35 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:32.491418 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-1fb13ebb-1040-4323-8fb6-87e5f2b71e35 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091554 Jun 20 11:02:32.491966 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 20 11:02:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:02:33.324907 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: DEBUG nova.api.openstack.wsgi [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] Calling method '>' {{(pid=103233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:33.325938 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: INFO nova.api.openstack.requestlog [None req-89d8ef86-188a-4692-ae7b-85c41d506b40 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 20 11:02:33.326347 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: [pid: 103233|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 20 11:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:02:33.532614 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG nova.api.openstack.wsgi [None req-578b1dad-bc51-418f-bd8e-7b02dcab18d6 admin admin] Calling method '>' {{(pid=103234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:02:33.533756 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 11:02:33.533756 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: warnings.warn(msg) Jun 20 11:02:33.535273 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-578b1dad-bc51-418f-bd8e-7b02dcab18d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:33.535723 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-578b1dad-bc51-418f-bd8e-7b02dcab18d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:33.536505 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-578b1dad-bc51-418f-bd8e-7b02dcab18d6 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:02:33.536913 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: DEBUG oslo_concurrency.lockutils [None req-578b1dad-bc51-418f-bd8e-7b02dcab18d6 admin admin] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:02:33.559561 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: INFO nova.api.openstack.requestlog [None req-578b1dad-bc51-418f-bd8e-7b02dcab18d6 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092533 Jun 20 11:02:33.560112 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: [pid: 103234|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 20 11:02:33 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:03:29.526335 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: Mon Jun 20 11:03:29 2022 - graceful shutdown triggered... Jun 20 11:03:29.526520 dv-cinder-846146-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 11:03:29.527858 dv-cinder-846146-3-iscsi devstack@n-api.service[103233]: Gracefully killing worker 1 (pid: 103233)... Jun 20 11:03:29.528241 dv-cinder-846146-3-iscsi devstack@n-api.service[103234]: Gracefully killing worker 2 (pid: 103234)... Jun 20 11:03:30.529065 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: worker 1 buried after 1 seconds Jun 20 11:03:30.529065 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: worker 2 buried after 1 seconds Jun 20 11:03:30.529065 dv-cinder-846146-3-iscsi devstack@n-api.service[103232]: goodbye to uWSGI. Jun 20 11:03:30.531030 dv-cinder-846146-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 11:03:30.531720 dv-cinder-846146-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 11:03:30.535266 dv-cinder-846146-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 11:03:30.547552 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 11:03:30 2022] *** Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: nodename: dv-cinder-846146-3-iscsi Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: machine: x86_64 Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: clock source: unix Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: pcre jit disabled Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: detected number of CPU cores: 4 Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: current working directory: / Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: detected binary path: /usr/bin/uwsgi-core Jun 20 11:03:30.550909 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: your processes number limit is 47680 Jun 20 11:03:30.551982 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: your memory page size is 4096 bytes Jun 20 11:03:30.551982 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: detected max file descriptor number: 2048 Jun 20 11:03:30.551982 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: lock engine: pthread robust mutexes Jun 20 11:03:30.551982 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: thunder lock: enabled Jun 20 11:03:30.551982 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 11:03:30.551982 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 11:03:30.597932 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: Python main interpreter initialized at 0x559ab98439c0 Jun 20 11:03:30.597932 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: python threads support enabled Jun 20 11:03:30.597932 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: your server socket listen backlog is limited to 100 connections Jun 20 11:03:30.597932 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: your mercy for graceful operations on workers is 90 seconds Jun 20 11:03:30.598489 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 11:03:30.598619 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: *** Operational MODE: preforking *** Jun 20 11:03:30.598881 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: *** uWSGI is running in multiple interpreter mode *** Jun 20 11:03:30.598881 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: spawned uWSGI master process (pid: 117585) Jun 20 11:03:30.599104 dv-cinder-846146-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 11:03:30.599759 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: spawned uWSGI worker 1 (pid: 117605, cores: 1) Jun 20 11:03:30.610128 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: spawned uWSGI worker 2 (pid: 117606, cores: 1) Jun 20 11:03:30.610128 dv-cinder-846146-3-iscsi devstack@n-api.service[117585]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 11:03:31.251642 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 11:03:31.277305 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 11:03:32.461118 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:03:32.461118 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: from cryptography.utils import int_from_bytes Jun 20 11:03:32.461765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:03:32.461765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: from cryptography.utils import int_from_bytes Jun 20 11:03:32.468065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:03:32.468065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jun 20 11:03:32.468557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 11:03:32.468557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: from cryptography.utils import int_from_bytes Jun 20 11:03:34.865152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 11:03:34.865865 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 11:03:34.865956 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 11:03:34.866308 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 11:03:34.866561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 11:03:34.867346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.867685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.868004 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.868289 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.868623 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.868976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.869254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.869571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.869958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.870254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.870590 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.870908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-3-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.871232 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.871534 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.871843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.872160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.872433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.872755 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.873061 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.873575 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875530 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.875880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.876197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.876530 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.876820 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.877223 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-3-iscsi {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.877549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.877863 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.878193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.878628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.878920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.879226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.879564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.879878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.880178 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.880492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.880813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.881157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.881455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.881750 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.882064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.882391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.882706 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.883013 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.883300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.883553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.883885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.884208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.884526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.884842 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.885092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.885340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.885709 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.886020 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.886351 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.886646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.886959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.887279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.887569 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.887876 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.888179 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.888488 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.888805 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.889127 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.889445 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.889739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.890068 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.890501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.890752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.891043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.891401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.891716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.892019 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.892337 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.892655 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.892957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.893263 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.893560 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.893891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.894241 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.894562 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.894809 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.895108 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.895412 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.895730 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.896033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.896336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.896641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.896933 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.897243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.897549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.897836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.898168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.898476 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.898778 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.899088 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.899383 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.899695 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.900015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.900325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.900628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.900934 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.901420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.901802 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.902339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.902648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.902958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.903294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.903982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.903982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.904242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.904531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.904825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.905141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.905550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.909364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.910694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.911816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.911816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.911816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.911816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.911816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.912501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.912501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.912785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.913011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.913338 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.913648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.913965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.914300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.914612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.914931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.915247 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.915404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 11:03:34.915890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 11:03:34.916040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.916040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.916317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 11:03:34.916466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.916615 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 11:03:34.916912 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.917162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 11:03:34.917599 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.919471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.919635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.919635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.919635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.920079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.920229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.920380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.920521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.920679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.920822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.920961 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.921101 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.921250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.921405 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.921568 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.921716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.921865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.922060 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.922224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.922224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.922513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.922864 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.923014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.923725 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846146-3-iscsi {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.923832 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.923937 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.924033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.924125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.924216 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.924301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.924386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.924476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.924570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.924659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.924748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.924842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.924932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.925104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.925363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.925542 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925622 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.925702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.925887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.925977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.926070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.926199 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.926290 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.926372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.926470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.926553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.926633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.926713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.926793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.926880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.926970 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.927064 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.927148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.927238 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846146-3-iscsi {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.927321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.927410 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.927531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.927699 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.927854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.928008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.928605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.928695 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.928778 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.928869 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.928951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.929040 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.929122 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.929291 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.929418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.929603 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.929724 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.929899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.930241 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.930338 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.930557 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.930649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.930869 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.930979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.931180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.931279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.931474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.931564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.931777 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.931877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.932085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.932176 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.932481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.932576 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.933008 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.933324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.933421 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.933638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.933726 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.933887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.933985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.934227 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.934343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.934547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.934646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.934864 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.934969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.935184 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.935277 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.935433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.935525 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.935677 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.935809 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.935989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.936125 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.936305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.936462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.936634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.936799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.936896 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.937110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.937209 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.937437 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.937528 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.937764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.937852 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.938066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.938193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.938387 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.938488 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.938686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.938776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.938991 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.939088 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.939298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.939388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.939600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.939697 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.939903 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.939999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.940206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.940296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.940512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.940611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.940816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.940907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.941119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.941221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.941420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.941516 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.941744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.941833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.942044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.942278 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.942382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.942468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.942666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.942757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.942983 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.943088 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.943279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.943358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.943621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.943963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.944398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.944721 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.945056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.945362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.945607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.945908 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.946238 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.946885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.946979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.947202 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.947509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.947641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.947946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.948181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.948463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.948644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.949055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.949150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.949383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.949551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.949699 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.949952 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.950064 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.950327 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.950430 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.950661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.950759 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.951003 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.951100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.951405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.951512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.951623 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.951742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.951950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.952055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.952270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.952382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.952575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.952681 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.952876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.952975 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.953179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.953287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.953480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.953594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.953899 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.954005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.954267 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.954378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.954574 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.954713 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.954890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.955181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.955327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.955525 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.955682 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.955820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.955957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.956081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.956211 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.956369 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.956507 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.956681 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.956808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.956982 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.957117 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.957287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.957431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.957602 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.957729 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.957905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.958033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.958270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.958426 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.958552 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.958676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.958808 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.958942 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.959115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.959243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.959416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.959545 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.959716 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.959858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.960141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.960291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.960494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.960622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.960746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.960883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.961017 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.961148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.961271 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.961410 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.961596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.961723 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.961862 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.962014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.962159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 11:03:34.962408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.962543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.962738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.962868 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.963047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.963174 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.963362 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.963498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.964557 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.964704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.964704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.964951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965342 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965678 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965816 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.965950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.966178 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.966378 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.966498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.966604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.966743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.966872 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967271 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967789 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.967945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.968081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.968257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.968393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.968569 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.968710 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.968875 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969189 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969499 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.969940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.970257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.970389 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.970543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.970748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.970883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971136 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971268 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971402 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971527 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.971878 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972304 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972612 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.972924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.973051 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.973249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.973385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.973554 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.973687 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.973867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974008 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.974958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.975117 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.975252 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.975423 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.975557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.975744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.975885 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976052 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976165 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976777 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.976981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.977089 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.977287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.977384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.977594 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.977875 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.977973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.978211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.978310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.978512 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.978625 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.978809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.978900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.979113 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.979222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.979544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.979848 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.979947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.980180 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.980275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.980513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.980602 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.980820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.980919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.981136 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.981234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.981441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.981531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.981748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.981837 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982478 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982688 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.982992 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.983089 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.983297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.983393 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.983599 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.983691 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.983920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984024 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984526 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.984953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.985162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.985256 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.985450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.985626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.985781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986210 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986631 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.986928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987506 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987651 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.987940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.988076 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.988221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.988395 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.988579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.988720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.988867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989016 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989446 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989584 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989721 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.989860 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.990005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.990197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.990367 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.990663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.990823 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.991064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.991229 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.991370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.991508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.991712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.991877 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992088 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992242 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992683 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992830 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.992977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.993126 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.993283 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.993422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.993559 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.993705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.993844 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.994065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.994244 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.994385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.994525 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.994663 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.994815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.995028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.995274 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.995485 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.995630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.995630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.995630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996255 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996691 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.996983 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997414 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997558 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997707 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.997990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.998147 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.998303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.998454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.998600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.998738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.998882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999019 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:34.999891 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.000035 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.000182 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.000339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.000488 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.000788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.000932 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.001096 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.001334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.001486 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.001626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.001764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.001903 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.002066 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.002813 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.002956 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003102 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003389 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003542 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.003979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.004117 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.004261 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.004409 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.004557 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.004772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.004913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.005058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.005203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.005462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.005670 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.005815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.005975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.006158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.006402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.006549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.006690 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.006827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.006964 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007103 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007686 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.007974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008415 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008562 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008703 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.008991 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.009138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.009284 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.009430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.009575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.009735 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.009876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.010021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.010192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.010339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.010498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.010661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.011067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.011217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.011374 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.011593 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.011743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.011893 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012051 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012200 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012339 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012766 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.012906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013321 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013762 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.013920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014059 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014241 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014686 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.014979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.015119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.015264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.015427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.015654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.015858 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016022 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016538 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016683 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016828 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.016966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017113 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017406 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017546 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017691 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.017998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.018171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.018315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.018460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.018608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.018920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.019148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.019300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.019450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.019589 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.019728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.019874 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.020915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.021212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.021357 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.021504 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.021736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.021894 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.022034 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.022233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.022375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.022513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.022670 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.022819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.023502 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.023652 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.023799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.023939 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024225 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024652 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024797 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.024953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.025101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.025248 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.025392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.025548 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.025772 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.026005 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.026219 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.026444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.026444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.026821 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027186 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027754 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.027899 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028054 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028194 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028332 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028478 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028784 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.028784 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.029776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030693 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.030987 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.031157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.031457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.031598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.031754 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.031973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032131 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032733 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032859 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.032960 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033057 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033248 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033430 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033527 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033782 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.033949 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034146 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034414 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034505 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034505 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.034933 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035368 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035547 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.035877 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036016 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036639 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036753 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.036849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037344 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037483 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.037953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.038123 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.038279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.038428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.038567 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.038712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.038868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039155 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039299 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039446 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039585 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.039870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040732 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.040878 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.041031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.041169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.041336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.041631 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.041821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.042002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.042364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.042364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.042668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.042815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.042980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.043133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.043280 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.043421 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.043573 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.043735 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.043880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.044073 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.044226 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.044381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.044542 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.044714 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.044867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.045048 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.045193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.045411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.045551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.045689 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.045827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.046049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.046233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.046391 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.046541 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.046701 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.046924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047215 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047363 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047664 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047817 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.047965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048394 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048688 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.048985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.049125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.049270 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.049416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.049563 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.049703 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.049855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050169 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050313 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050755 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.050902 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.051042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.051187 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.051333 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.051485 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.051795 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.051946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.052084 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.052223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.052379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.052633 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.052797 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.052937 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053220 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.053945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.054113 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.054259 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.054408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.054564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.054703 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.054843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055001 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055149 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055604 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055756 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.055918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.056079 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.056292 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.056441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.056607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.056762 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.056928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.057151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.057309 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.057562 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.057709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.057709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058328 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.058959 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.059106 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.059260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.059405 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.059558 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.059712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.059866 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060158 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060768 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.060912 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.061066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.061213 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.061366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.061512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.061663 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.061969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.062150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.062311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.062473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.062637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.062874 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063335 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063488 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.063786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.064086 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.064246 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.064399 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.064553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.064710 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.064862 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065175 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065323 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.065926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.066080 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.066300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.066524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.066693 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.066864 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.067094 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.067329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.067489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.067636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.067799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.067947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.068107 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.068254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.068406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.068560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.068706 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.068861 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.069926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.070072 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.070254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.070402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.070550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.070724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.070878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.071023 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.071023 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.071665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.071816 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.072136 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.072298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.072451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.072606 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.072752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.072928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.073437 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.073605 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.073754 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.073907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.074128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.074296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.074443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.074443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.074443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.074858 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075316 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075625 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075777 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.075924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.076081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.076228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.076379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.076549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.076699 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.076858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.077013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.077013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.077324 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.077553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.077703 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.077859 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078341 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.078946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.079100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.079246 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.079390 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.079553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.079710 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.079856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080147 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080299 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.080909 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081056 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081201 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081356 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081512 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.081962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.082278 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.082446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.082446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.082732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.082887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083039 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083627 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083780 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.083926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084755 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084908 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.084908 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.085217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.085366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.085528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.085528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.085820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.085979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.086162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.086315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.086472 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.086618 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.086771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.086931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.087084 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.087229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.087375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.087375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.087771 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.087928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.088076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.088228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.088381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.088527 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.088765 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.088920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089220 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089517 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.089689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.090143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.090143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.090438 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.090594 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.090739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.090890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091360 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091506 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.091969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.092114 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.092438 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.092605 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.092752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.092897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093186 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093345 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.093955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.094133 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.094304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.094459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.094611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.094757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.094910 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095223 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095676 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095823 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.095976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.096123 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.096267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.096411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.096562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.096715 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.096948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.097103 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.097249 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.097402 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.097549 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.097714 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.097953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.098127 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.098290 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.098436 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.098589 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.098744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.098891 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099045 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099199 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099345 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099669 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099816 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.099969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.100115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.100259 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.100413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.100568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.100714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.100865 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101012 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101617 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101763 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.101907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.102060 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.102243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.102243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.102716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.102868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103330 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.103931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.104084 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.104253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.104413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.104559 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.104713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.104858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105012 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105166 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105166 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.105915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.106059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.106275 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.106421 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.106577 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.106730 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.106892 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107038 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107794 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.107961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.108177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.108336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.108481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.108635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.108780 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.108931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109844 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.109988 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.110157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.110308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.110473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.110619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.110764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.110915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111682 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111829 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.111974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.112132 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.112278 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.112430 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.112670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.112921 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.113073 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.113234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.113393 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.113538 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.113691 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.113836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114171 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114478 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.114932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.115077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.115271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.115437 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.115584 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.115737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.115891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116480 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116633 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116779 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.116924 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.117076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.117220 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.117374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.117528 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.117675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.117838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.118000 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.118210 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.118430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.118590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.118736 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.118889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119035 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119489 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119794 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.119999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.120207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.120368 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.120579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.120855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121149 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121149 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121149 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121723 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.121875 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.122029 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.122216 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.122363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.122508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.122678 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.122911 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.123139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.123306 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.123462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.123642 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.123788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.123940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124086 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124673 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124817 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.124970 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.125125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.125273 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.125425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.125591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.125591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.125976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.126158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.126310 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.126463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.126609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.126761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.126920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127066 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.127957 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.128109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.128255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.128415 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.128632 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.128801 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.128949 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 11:03:35.129378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.129951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.130273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.130427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.130708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.131010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.131313 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.131615 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.131925 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.132224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.132529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.132831 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.133218 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.133437 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.133736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.134041 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.134364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.134673 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.134971 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.135277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.136200 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.136512 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.136826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.137131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.137449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.138272 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.138272 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.138455 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.138693 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.139065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.139380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.139884 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.140212 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.140526 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.141535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.141535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.141535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.141970 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.142074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.142367 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.142674 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.142981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.143322 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.143612 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.143922 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.144213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.144520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.144827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.145133 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.145443 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.145756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.146065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.146398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.146711 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.147051 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.147367 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.147683 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.148000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.148314 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.148620 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.148927 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.149233 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.149539 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.149851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.150203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.150516 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.150819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.151817 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.152139 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.152460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.152783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.153095 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.153499 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.153741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.154052 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.154400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.154710 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.155037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.155371 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.155697 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.156397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.156397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.156614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.156916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.157220 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.157537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.157845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.158168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.158469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.158773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.159072 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.159375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.159677 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.159977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.160283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.160578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.160878 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.161175 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.161474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.161773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.162071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.162396 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.162697 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.162996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.163295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.163598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.163890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.164221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.164550 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.164864 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.165184 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.165494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.165815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.166142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.166465 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.166833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.167610 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.167927 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.168261 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.168572 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.168883 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.169199 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.169733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.169881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.170130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.170460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.170786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.171090 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.171412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.171728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.172045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.172356 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.172661 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.172989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.173298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.173605 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.173915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.174243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.174555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.174868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.175179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.175503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.175842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.176128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.176453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.176774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.177118 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.177427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.177765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.178118 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.178423 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.178732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.179032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 11:03:35.179270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 11:03:35.189961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Registered counter for database nova_api Jun 20 11:03:35.210688 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.217671 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.242396 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Registered counter for database nova_api Jun 20 11:03:35.263241 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.270179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.276688 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.context [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8d171c-705f-4ce5-ac91-b59b7b5effe3(cell1) {{(pid=117606) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 11:03:35.280856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:03:35.282493 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:03:35.283300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:03:35.285315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:03:35.287353 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Registered counter for database nova_cell0 Jun 20 11:03:35.291407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Registered counter for database nova_cell1 Jun 20 11:03:35.299050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.300902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.306583 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.312128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.327831 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.context [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8d171c-705f-4ce5-ac91-b59b7b5effe3(cell1) {{(pid=117605) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 11:03:35.331946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:03:35.333544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:03:35.334361 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:03:35.336923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:03:35.338417 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Registered counter for database nova_cell0 Jun 20 11:03:35.343167 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Registered counter for database nova_cell1 Jun 20 11:03:35.350790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.352597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.359143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.360543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.459206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO dbcounter [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Registered counter for database nova_cell0 Jun 20 11:03:35.466545 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_db.sqlalchemy.engines [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.471167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writer thread running {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.511485 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Registered counter for database nova_cell0 Jun 20 11:03:35.518942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 11:03:35.523637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 11:03:35.793400 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:03:35.800893 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:03:35.839195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:03:35.846798 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:03:36.152023 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:03:36.158049 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: WARNING keystonemiddleware.auth_token [None req-2991e0b8-63fa-4f2b-b95b-256d87a5a2c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:03:36.163445 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ab98439c0 pid: 117606 (default app) Jun 20 11:03:36.189363 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 11:03:36.195412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b3f3caaf-4cfa-4185-92fd-36e1e0f796d5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 11:03:36.201160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ab98439c0 pid: 117605 (default app) Jun 20 11:04:16.211512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:16.212893 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:16.214873 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:16.216594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:17.756513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4d930088-791b-45ff-b655-d26ec70d93f7 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Action: 'create', calling method: .version_select at 0x7f7217a52700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1729725264", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:19.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:19.165014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:19.166357 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:19.169873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:19.759449 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4d930088-791b-45ff-b655-d26ec70d93f7 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.566899 Jun 20 11:04:19.766464 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 20 11:04:16 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3575 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 11:04:19.773233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e3a69b3-3413-40b2-8f7e-aca4ea0462d4 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Calling method '.version_select at 0x7f7217918550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:19.844159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-79ad2d92-c5ed-491e-920b-797e3c051c02 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7217a9f280>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:19.934261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e3a69b3-3413-40b2-8f7e-aca4ea0462d4 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b" status: 200 len: 353 microversion: 2.1 time: 0.165701 Jun 20 11:04:19.935408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 2/2] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:19 2022] GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b => generated 353 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:20.669080 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-79ad2d92-c5ed-491e-920b-797e3c051c02 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/264dfd46-60b0-45f4-a8cd-5bf620a07b22" status: 200 len: 350 microversion: 2.1 time: 1.511502 Jun 20 11:04:20.670500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 1/3] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:19 2022] GET /compute/v2.1/os-volumes/264dfd46-60b0-45f4-a8cd-5bf620a07b22 => generated 350 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:04:20.949564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f13617a3-dc34-4f6a-9183-66f12394f18b tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Calling method '.version_select at 0x7f7217918700>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:21.150160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f13617a3-dc34-4f6a-9183-66f12394f18b tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b" status: 200 len: 354 microversion: 2.1 time: 0.206106 Jun 20 11:04:21.156047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:20 2022] GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:21.180470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5582c35d-9569-4395-a6ee-85d5ab8e2554 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Calling method '.version_select at 0x7f7217965550>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:21.315893 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5582c35d-9569-4395-a6ee-85d5ab8e2554 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b" status: 200 len: 354 microversion: 2.1 time: 0.156296 Jun 20 11:04:21.317313 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 2/5] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:21 2022] GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:21.353101 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-355eb12e-4d67-4dae-91db-04e192408521 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Calling method '.version_select at 0x7f7217918ca0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:21.621631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-355eb12e-4d67-4dae-91db-04e192408521 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b" status: 202 len: 0 microversion: 2.1 time: 0.285904 Jun 20 11:04:21.622365 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 4/6] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:04:21 2022] DELETE /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:04:21.636247 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-157b944f-eda4-48a7-83d7-f372db979d3d tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Calling method '.version_select at 0x7f7217965ca0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:21.778149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-157b944f-eda4-48a7-83d7-f372db979d3d tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b" status: 200 len: 353 microversion: 2.1 time: 0.151172 Jun 20 11:04:21.781160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 3/7] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:21 2022] GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:22.322338 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d461d05-e7ea-42bd-9a91-56d68b6b8290 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f72178b23a0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:22.456400 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d461d05-e7ea-42bd-9a91-56d68b6b8290 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/b977655c-f7c4-445a-b200-ede7febc798c" status: 200 len: 350 microversion: 2.1 time: 0.142347 Jun 20 11:04:22.456920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:22 2022] GET /compute/v2.1/os-volumes/b977655c-f7c4-445a-b200-ede7febc798c => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:22.794423 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-338eefed-fa9b-47fc-83fa-75fcf9f754d3 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Calling method '.version_select at 0x7f72179183a0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:23.248275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-338eefed-fa9b-47fc-83fa-75fcf9f754d3 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] HTTP exception thrown: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-338eefed-fa9b-47fc-83fa-75fcf9f754d3 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Request method failure captured: Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b HTTP/1.1 Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQwoKhmqdfxoONYwtpjL5ocnI-fKeT9Jc2IaFfVN-aMT_t5VC_-FvG7hx7Fdf1_JVtkDN5C6vG8VutdL6gR0xMIjBoduqJlgndnro9FwaCD7ekM5uLMcS7VZGkO_DPspipnBbfubmZIDQ8chKSqdPYwMqxnz1xgDi1u96efMHqgjXo Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: bc0db5d97aee425dbfc522a22162a6b1 Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesGetTestJSON-1652759843 Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:04:23.256400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bc0db5d97aee425dbfc522a22162a6b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc0db5d97aee425dbfc522a22162a6b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bc0db5d97aee425dbfc522a22162a6b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bc0db5d97aee425dbfc522a22162a6b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesGetTestJSON-1652759843 Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: bc0db5d97aee425dbfc522a22162a6b1 Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesGetTestJSON-1652759843 Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesGetTestJSON-1652759843-project Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 3170ca4f0dfb40768cef22a1be8a95e1 Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesGetTestJSON-1652759843-project Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'a5c7744d-4ce9-46f6-b317-3ded315bac7b'} Jun 20 11:04:23.257563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. (HTTP 404) (Request-ID: req-ed649dfa-877f-4af7-abae-24994840f8b8) Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:04:23.258208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:04:23.259059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 11:04:23.259923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. Jun 20 11:04:23.261029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:04:23.265152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-338eefed-fa9b-47fc-83fa-75fcf9f754d3 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] Returning 404 to user: Volume a5c7744d-4ce9-46f6-b317-3ded315bac7b could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:04:23.266329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-338eefed-fa9b-47fc-83fa-75fcf9f754d3 tempest-VolumesGetTestJSON-1652759843 tempest-VolumesGetTestJSON-1652759843-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b" status: 404 len: 109 microversion: 2.1 time: 0.477895 Jun 20 11:04:23.271684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 4/9] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:22 2022] GET /compute/v2.1/os-volumes/a5c7744d-4ce9-46f6-b317-3ded315bac7b => generated 109 bytes in 483 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:04:29.032781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1171156218", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "networks": [{"uuid": "411bd6a0-1af4-4e2d-971c-57c6e000aedb"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:29.352321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] validate_networks() for [('411bd6a0-1af4-4e2d-971c-57c6e000aedb', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:04:30.725919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-56c3318f-b8ea-4ebd-a610-4f0fb90db245 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: .version_select at 0x7f721827cb80>, body: {"keypair": {"name": "tempest-keypair-93270669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+/ApQbySnuVwQMEJKAqgkrEeUD+0ZZV9y/m+3MTKfVjVkoH5ZO+qAHMROD8xTZqp7l6Rz/nU5MKggr+sc+rvnH4bdjb7wtpl9A+cfRuTfon29c6ZyxfHysIScAdjAR6Q=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:30.863904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-56c3318f-b8ea-4ebd-a610-4f0fb90db245 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:04:30.877776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-56c3318f-b8ea-4ebd-a610-4f0fb90db245 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for user 48e77af2b3a2409fa6d352b0d2674b85 and project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:04:31.000631 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-56c3318f-b8ea-4ebd-a610-4f0fb90db245 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.094544 Jun 20 11:04:31.001909 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 5/10] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:04:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:31.395651 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e91876da-b61a-42fe-a611-8a3f263d1ed1 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f721785faf0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:31.580224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e91876da-b61a-42fe-a611-8a3f263d1ed1 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/33a986d1-0089-46a1-9016-4de0f3e8998e" status: 200 len: 351 microversion: 2.1 time: 0.189451 Jun 20 11:04:31.581008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:04:31 2022] GET /compute/v2.1/os-volumes/33a986d1-0089-46a1-9016-4de0f3e8998e => generated 351 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:04:31.594693 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-02fc2b92-64ef-4ef7-ac9a-d0976bed3c28 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7217011160>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:31.791401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-02fc2b92-64ef-4ef7-ac9a-d0976bed3c28 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.202408 Jun 20 11:04:31.792438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jun 20 11:04:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:04:31.805613 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d76156f8-47b8-4f0b-89af-f8c51d8e65f6 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f721785fee0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:31.841123 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:04:31.841621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:04:31.842062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:04:31.842684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:04:31.843116 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:04:31.877231 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:31.878552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:31.881193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:31.881848 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:31.985629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Getting quotas for project 1e27652a0a2f4421aed586e23a86d0ae. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:04:32.014629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Getting quotas for user 14d3e513d8ce4efc87a359e04a77f05b and project 1e27652a0a2f4421aed586e23a86d0ae. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:04:32.058694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:04:32.073575 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:04:32.301683 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dd6a0a8d-bf2d-4294-a18f-8b563448986b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.786614 Jun 20 11:04:32.302555 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 6/13] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:04:32.441956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d76156f8-47b8-4f0b-89af-f8c51d8e65f6 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.640805 Jun 20 11:04:32.443094 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 8/14] 10.222.0.33 () {58 vars in 1148 bytes} [Mon Jun 20 11:04:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:32.449174 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3025fbf0-2415-499e-a035-04ee1c23a67b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:32.451635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3025fbf0-2415-499e-a035-04ee1c23a67b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:32.638911 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-8179890", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:32.735504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3025fbf0-2415-499e-a035-04ee1c23a67b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:32.772648 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3025fbf0-2415-499e-a035-04ee1c23a67b tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1215 microversion: 2.1 time: 0.325618 Jun 20 11:04:32.777192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 9/15] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:32 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:32.782462 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-75b236bf-f932-40e8-b43b-31cefe5beec1 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7217011ee0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:32.784644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] validate_networks() for [('04557a71-deaf-40bc-8f15-93648301a3a2', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:04:33.076822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-75b236bf-f932-40e8-b43b-31cefe5beec1 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.298341 Jun 20 11:04:33.084030 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 10/16] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jun 20 11:04:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:33.088846 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a14b109c-bac3-4d24-8b6e-7113c7240acd tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7216fd6af0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:33.313550 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a14b109c-bac3-4d24-8b6e-7113c7240acd tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.228335 Jun 20 11:04:33.314679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 11/17] 10.222.0.33 () {58 vars in 1166 bytes} [Mon Jun 20 11:04:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:33.329533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2f6dd982-c994-47a2-95ff-f53a4d5c3ecd tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7216fd6ca0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:33.545990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2f6dd982-c994-47a2-95ff-f53a4d5c3ecd tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.222167 Jun 20 11:04:33.553635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 12/18] 10.222.0.33 () {58 vars in 1169 bytes} [Mon Jun 20 11:04:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:33.562664 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-14b6121b-00ee-4572-ac4d-0be6d0273155 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7216fc6040>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:33.837914 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-14b6121b-00ee-4572-ac4d-0be6d0273155 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.281652 Jun 20 11:04:33.840630 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 13/19] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jun 20 11:04:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:04:33.852952 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-97a011a5-0b1d-43ae-85c9-543ef686910c tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:33.863699 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-97a011a5-0b1d-43ae-85c9-543ef686910c tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:33.965104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:04:33.966069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:04:33.966867 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:04:33.967581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:04:33.968253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:04:33.999972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-97a011a5-0b1d-43ae-85c9-543ef686910c tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:34.004291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:34.008104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:34.011028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-97a011a5-0b1d-43ae-85c9-543ef686910c tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1215 microversion: 2.1 time: 0.167309 Jun 20 11:04:34.012556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 14/20] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:33 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:34.017370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:34.017833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:34.027418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0bb9ba84-d501-42bf-8863-9f97183a9640 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7216fd6550>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:34.130597 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:04:34.156948 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for user 0c4a4ce86beb47c2b7910264a9238c8b and project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:04:34.191175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:04:34.202494 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:04:34.284956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0bb9ba84-d501-42bf-8863-9f97183a9640 tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.267303 Jun 20 11:04:34.285644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 15/21] 10.222.0.33 () {58 vars in 1187 bytes} [Mon Jun 20 11:04:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:34.302328 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-641f8209-1d0a-4bd2-b366-bdf522cc7aad tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] Calling method '.version_select at 0x7f7216fe2ca0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:34.352510 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b82757d0-8cb1-484c-b46a-25c2f2f97690 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.045424 Jun 20 11:04:34.361630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 7/22] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:04:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:04:34.390562 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3e089de5-179b-43e1-a013-1cb4cdbc1e3b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:34.396586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3e089de5-179b-43e1-a013-1cb4cdbc1e3b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:34.637795 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-641f8209-1d0a-4bd2-b366-bdf522cc7aad tempest-VolumesTestJSON-348753819 tempest-VolumesTestJSON-348753819-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.340258 Jun 20 11:04:34.650902 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 16/23] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jun 20 11:04:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:34.897738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3e089de5-179b-43e1-a013-1cb4cdbc1e3b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:34.949061 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3e089de5-179b-43e1-a013-1cb4cdbc1e3b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1219 microversion: 2.1 time: 0.583959 Jun 20 11:04:34.970597 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 8/24] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:34 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1219 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:35.031296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:35.033224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:35.062056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:35.069064 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:35.080563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:35.081476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:35.297036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-860559995", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:35.470229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] validate_networks() for [('04557a71-deaf-40bc-8f15-93648301a3a2', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:04:35.613540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:35.633608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ee19730b-e6d0-4f15-a9ae-c01d5b7cc2b4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1219 microversion: 2.1 time: 0.607512 Jun 20 11:04:35.636476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 17/25] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:35 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1219 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:36.654786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:36.656543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:36.685447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:36.685902 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:36.709971 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:36.710375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:37.295067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:37.339761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-533528f0-a6cf-4925-919e-2c75f6753a21 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1285 microversion: 2.1 time: 0.671214 Jun 20 11:04:37.346697 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 18/26] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:36 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1285 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:37.610464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1324079018", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2838ade6-e0cf-48ef-bf2a-3dd3bebd20c7"}], "security_groups": [{"name": "tempest-securitygroup--1090511680"}], "key_name": "tempest-keypair-93270669", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:37.701391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:04:37.701882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:04:37.702492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:04:37.703051 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:04:37.703599 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:04:37.721071 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:37.722656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:37.724284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:37.728053 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:37.794901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:04:37.815972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for user 0c4a4ce86beb47c2b7910264a9238c8b and project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:04:37.888579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:04:37.891040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:04:38.029371 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63312fd5-b9be-491b-bc87-c2489838a479 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.737693 Jun 20 11:04:38.030374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 9/27] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:04:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 11:04:38.062679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1a4fdc9-f4f0-4a9c-b6fe-678b506ef6a8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:38.063552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1a4fdc9-f4f0-4a9c-b6fe-678b506ef6a8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:38.529015 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] validate_networks() for [('2838ade6-e0cf-48ef-bf2a-3dd3bebd20c7', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:04:39.034874 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c1a4fdc9-f4f0-4a9c-b6fe-678b506ef6a8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:39.056239 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1a4fdc9-f4f0-4a9c-b6fe-678b506ef6a8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1221 microversion: 2.1 time: 1.019484 Jun 20 11:04:39.077746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 10/28] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:38 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1221 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:39.107009 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:39.112404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:39.164689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:39.172219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:39.173151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:39.173600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:40.434463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:40.471176 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2dfab977-b5a6-4b2f-ad3a-11d1bb6cf45d tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1273 microversion: 2.1 time: 1.387826 Jun 20 11:04:40.483850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 11/29] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:39 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1273 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:40.521528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:40.526001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:40.554784 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:40.562703 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:40.566932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:40.568902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:41.331904 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:41.352284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d34f0eca-610a-4399-8a95-dcca0e496aa8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1273 microversion: 2.1 time: 0.867655 Jun 20 11:04:41.357384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 12/30] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:40 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1273 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:41.497736 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:41.500383 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:41.550260 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:41.552023 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:41.554554 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:41.555883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:42.117213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:04:42.117846 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:04:42.118137 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:04:42.118822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:04:42.119375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:04:42.151418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:42.170305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:42.174902 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:42.175375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:42.283882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:04:42.306203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for user 48e77af2b3a2409fa6d352b0d2674b85 and project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:04:42.353949 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:04:42.365721 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:04:42.579264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5d7cc130-7d69-44cb-b1aa-64a48526f10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.973825 Jun 20 11:04:42.580357 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 19/31] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:04:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 4976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 11:04:42.592892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:42.593994 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:42.604011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:42.604962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:42.607361 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:42.607982 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:43.173277 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:43.189190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0ffce58-36a7-48a8-afce-eaba39a15a92 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 1.700610 Jun 20 11:04:43.198788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 13/32] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:41 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:43.219366 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a10cc6e7-443e-49e8-b157-3c041913216c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:43.222748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a10cc6e7-443e-49e8-b157-3c041913216c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:43.391687 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:43.411685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9c23c5fa-c9d3-4a48-ba72-fc86ea827aad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1279 microversion: 2.1 time: 0.827837 Jun 20 11:04:43.420018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 20/33] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:42 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1279 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:43.560513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a10cc6e7-443e-49e8-b157-3c041913216c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:43.568604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a10cc6e7-443e-49e8-b157-3c041913216c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1236 microversion: 2.1 time: 0.368703 Jun 20 11:04:43.575187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 14/34] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:43 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1236 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:44.207354 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:44.209273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:44.222002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:44.225178 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:44.226802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:44.228623 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:44.437119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:44.438134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:44.445958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:44.446841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:44.448594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:44.449482 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:44.727162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:44.752928 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c47245e7-f2bb-4a50-af8c-0744c938cfe4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1279 microversion: 2.1 time: 0.319622 Jun 20 11:04:44.753783 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 15/35] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:44 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1279 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:44.762228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:44.763376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:44.791144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:44.803259 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:44.810367 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:44.811566 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:44.961851 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:44.976384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-68775f17-8a77-4703-ae08-2fa76becc1c6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1288 microversion: 2.1 time: 0.221315 Jun 20 11:04:44.984609 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 16/36] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:44 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1288 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:45.770896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:45.772745 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:45.784348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:45.785615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:45.787665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:45.788764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:46.088188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:46.097295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a3c81772-dd9e-4c9d-a3f8-e8fb60061439 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 1.893800 Jun 20 11:04:46.100916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 21/37] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:44 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:46.115177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:46.122975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:46.145942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:46.146698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:46.150240 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:46.150912 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:46.366825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:46.381210 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c6395996-ffb8-465b-b108-2b3dc2622b9b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1294 microversion: 2.1 time: 0.276577 Jun 20 11:04:46.383458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 22/38] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:46 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1294 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:47.121442 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:47.122214 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:47.136275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:47.141391 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:47.146301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:47.148618 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:47.543046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:47.559606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da3f9475-ec31-4f47-9c63-97ce49ef5389 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 1.793792 Jun 20 11:04:47.564859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 17/39] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:45 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:47.577955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:47.578604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:47.597144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:47.597610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:47.598485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:47.604622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:47.775077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:47.888834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:47.924857 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8b93c9f6-00db-4e61-af9e-331125d49311 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1294 microversion: 2.1 time: 0.358613 Jun 20 11:04:47.941474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 18/40] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:47 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1294 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:48.582951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:48.584210 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:48.598183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:48.599408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:48.600891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:48.602319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:48.603184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:48.626009 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ed875e69-c009-41ae-9ffa-c3d7fc8d5ed2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 1.510785 Jun 20 11:04:48.627577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 23/41] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:47 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:48.953481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:48.954128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:48.973547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:48.973991 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:48.975157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:48.978579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:49.311595 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:49.333752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ced525f0-85d9-4410-a969-6d0ccad969e8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1294 microversion: 2.1 time: 0.380851 Jun 20 11:04:49.338250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 24/42] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:48 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1294 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:04:49.767126 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-2171d9bf-c471-45d9-9fef-e8014659d9bd req-29bd5157-d0ec-40f7-be4e-b02d7a4379f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9621402-810b-4546-8a08-d5c9aa06af9b", "tag": "75ab2497-b005-4e17-9787-c9657ebec80b"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:49.831031 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2171d9bf-c471-45d9-9fef-e8014659d9bd req-29bd5157-d0ec-40f7-be4e-b02d7a4379f8 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:49.834893 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2171d9bf-c471-45d9-9fef-e8014659d9bd req-29bd5157-d0ec-40f7-be4e-b02d7a4379f8 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:49.901453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-2171d9bf-c471-45d9-9fef-e8014659d9bd req-29bd5157-d0ec-40f7-be4e-b02d7a4379f8 service nova] Creating event network-changed:75ab2497-b005-4e17-9787-c9657ebec80b for instance a9621402-810b-4546-8a08-d5c9aa06af9b on hv-cinder-84614 Jun 20 11:04:49.902650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2171d9bf-c471-45d9-9fef-e8014659d9bd req-29bd5157-d0ec-40f7-be4e-b02d7a4379f8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 11:04:49.904459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:49.905385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:49.907152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:49.917651 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:49.949434 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.compute.rpcapi [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 11:04:49.954251 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] Releasing lock "compute-rpcapi-router" {{(pid=117605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 11:04:50.010724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-022f8aec-a4e1-4cc8-a12d-2e886b7f7d01 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.669162 Jun 20 11:04:50.011482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 25/43] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:50.024582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:50.040970 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:50.068559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:50.069011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:50.069788 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:50.076966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:50.670773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:50.683510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-608710c6-6051-4ef2-a591-e89c1e0c3e91 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.670528 Jun 20 11:04:50.687161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 26/44] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:50 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:50.702910 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:50.710875 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:50.721926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:50.726258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:50.727208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:50.729704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:51.386595 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:51.391215 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:51.423853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0747105f-7e11-4f0c-a0c9-80357cd54673 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 2.845920 Jun 20 11:04:51.425107 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 19/45] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:48 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 2851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:51.425382 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ccd3ca81-cdb6-432d-bb20-c64d1aec8422 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.733512 Jun 20 11:04:51.426465 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 27/46] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:50 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:51.704721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:51.706063 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:51.719502 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:51.719963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:51.720900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:51.721338 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:52.064398 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:52.090477 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ea0a4e1-f2bf-4501-8384-64e674b83746 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.378397 Jun 20 11:04:52.091201 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 20/47] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:51 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:52.333079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=14 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:52.368391 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-241d02db-6d52-4731-9527-95e70105ae6f req-bc659f37-f692-4854-9198-b175818c190b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8963e2f6-7da5-4629-83bf-1ee968229650", "tag": "d17429a4-6d58-49e4-ad27-780b92838339"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:52.380149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-241d02db-6d52-4731-9527-95e70105ae6f req-bc659f37-f692-4854-9198-b175818c190b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:52.380575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-241d02db-6d52-4731-9527-95e70105ae6f req-bc659f37-f692-4854-9198-b175818c190b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:52.412922 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-241d02db-6d52-4731-9527-95e70105ae6f req-bc659f37-f692-4854-9198-b175818c190b service nova] Creating event network-changed:d17429a4-6d58-49e4-ad27-780b92838339 for instance 8963e2f6-7da5-4629-83bf-1ee968229650 on hv-cinder-84614 Jun 20 11:04:52.421770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-241d02db-6d52-4731-9527-95e70105ae6f req-bc659f37-f692-4854-9198-b175818c190b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340771 Jun 20 11:04:52.423205 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 28/48] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:04:52.442611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:52.442611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:52.456819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:52.458487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:52.459292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:52.459740 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:52.462745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:52.463635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:52.496796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:52.496796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:52.497441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:52.500621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:52.723988 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:52.733549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31b829f6-eed1-4f84-a356-13f3c10da02b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.296343 Jun 20 11:04:52.734836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 21/49] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:52 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:52.780718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:52.790691 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8235afe8-5269-4d8f-965a-af68defec3d2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.341424 Jun 20 11:04:52.791930 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 29/50] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:52 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:53.108924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:53.109895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:53.122342 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:53.122603 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:53.123381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:53.123815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:53.565261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=24 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:53.687427 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:53.699588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-82e4391d-1652-4e47-9cc4-ed8102a30df0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.595069 Jun 20 11:04:53.702768 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 22/51] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:53 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:53.752517 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:53.753700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:53.769582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:53.770833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:53.773345 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:53.775938 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:53.810879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:53.811558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:53.822034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:53.822510 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:53.826595 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:53.827204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:54.141990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:54.156535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7e920f74-6073-4086-a3b7-b443a589059c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.405113 Jun 20 11:04:54.176400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 30/52] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:53 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:54.292452 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:54.303215 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bb2e9b9e-f1f8-4365-9134-2299c97a8e2a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.496753 Jun 20 11:04:54.312918 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 23/53] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:53 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:04:54.463368 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-f5ea3ae8-5f9d-4a89-a90d-dad9cdc91e27 req-4b56473d-5d65-4175-8e3c-03f64e4dd0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd1d65c-bf4a-4973-97ca-7263bd5e6dde", "tag": "5ba94606-ffa2-4ad9-96db-221a22bbb4b4"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:54.493277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-f5ea3ae8-5f9d-4a89-a90d-dad9cdc91e27 req-4b56473d-5d65-4175-8e3c-03f64e4dd0a4 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:54.493562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-f5ea3ae8-5f9d-4a89-a90d-dad9cdc91e27 req-4b56473d-5d65-4175-8e3c-03f64e4dd0a4 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:54.522523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-f5ea3ae8-5f9d-4a89-a90d-dad9cdc91e27 req-4b56473d-5d65-4175-8e3c-03f64e4dd0a4 service nova] Creating event network-changed:5ba94606-ffa2-4ad9-96db-221a22bbb4b4 for instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde on hv-cinder-84614 Jun 20 11:04:54.528890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-f5ea3ae8-5f9d-4a89-a90d-dad9cdc91e27 req-4b56473d-5d65-4175-8e3c-03f64e4dd0a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074806 Jun 20 11:04:54.529940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 31/54] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:54.719632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:54.720307 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:54.729608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:54.730499 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:54.731514 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:54.732021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:54.904697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:54.913185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91a0910d-ece3-4d7e-9d2a-ac1af809b975 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.199510 Jun 20 11:04:54.917568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 24/55] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:54 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:55.184013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:55.184717 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:55.191619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:55.192074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:55.192840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:55.193274 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:55.319661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:55.320695 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:55.331376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:55.333151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:55.334246 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:55.334690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:55.409979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:55.420825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9d9c20a9-04ba-44fe-b6dc-6c41800f4815 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.240661 Jun 20 11:04:55.424071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 32/56] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:55 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:04:55.566184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:55.578508 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ec495355-fd65-4241-9e79-c5ed5ef686b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.262680 Jun 20 11:04:55.579151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 25/57] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:55 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:55.935311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:55.936180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:55.946404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:55.947296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:55.948507 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:55.949293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:56.255643 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:56.276712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b9b06a8d-8c18-4b52-a179-a7490472167f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.343663 Jun 20 11:04:56.286743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 33/58] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:55 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:56.440348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:56.441704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:56.449418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:56.450220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:56.451061 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:56.451735 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:56.595435 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:56.596363 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:56.603170 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:56.603832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:56.604822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:56.605523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:56.788468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:56.800018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c061309f-4f00-403e-85dc-d342356ba263 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.208465 Jun 20 11:04:56.801137 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 34/59] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:56 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:04:56.805922 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-c82d83de-29ff-4d4a-8319-1947bdcf0780 req-4cb0537b-3b3d-42dd-a4b1-edb74a6312f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe316d92-1158-4b44-b5c6-1c7c37e4c10d", "tag": "6416c894-1760-4713-ad6f-e0a40d7e0789"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:04:56.815439 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c82d83de-29ff-4d4a-8319-1947bdcf0780 req-4cb0537b-3b3d-42dd-a4b1-edb74a6312f5 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:56.816201 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c82d83de-29ff-4d4a-8319-1947bdcf0780 req-4cb0537b-3b3d-42dd-a4b1-edb74a6312f5 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:56.836624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-c82d83de-29ff-4d4a-8319-1947bdcf0780 req-4cb0537b-3b3d-42dd-a4b1-edb74a6312f5 service nova] Creating event network-changed:6416c894-1760-4713-ad6f-e0a40d7e0789 for instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d on hv-cinder-84614 Jun 20 11:04:56.844598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-c82d83de-29ff-4d4a-8319-1947bdcf0780 req-4cb0537b-3b3d-42dd-a4b1-edb74a6312f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041244 Jun 20 11:04:56.845928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 35/60] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:04:57.185831 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:57.195393 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a6599f7-11f2-47db-946f-29fde83b2c4b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.758925 Jun 20 11:04:57.211045 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 26/61] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:56 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:57.294996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:57.295718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:57.306761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:57.307440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:57.308432 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:57.309570 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:57.344211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:57.579493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:57.587365 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8cec2c76-61c3-46ca-9cf3-468d2a16717e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.296781 Jun 20 11:04:57.588562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 36/62] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:57 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:57.817446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:57.818054 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:57.828154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:57.828676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:57.829446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:57.829880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:57.856264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:58.022119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:58.030828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb660ba1-2e27-4923-a2e8-b99b332f744d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.217160 Jun 20 11:04:58.031480 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 27/63] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:57 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:58.213164 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:58.214327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:58.223744 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:58.224203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:58.225436 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:58.226011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:58.437926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:58.453397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-97e7bfe8-5608-45e8-851f-4e7a2eac1a5d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.244534 Jun 20 11:04:58.454180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 37/64] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:58 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:58.609979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:58.619109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:58.627783 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:04:58.632435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:58.632891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:58.633668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:58.634127 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:58.791945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:58.800394 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-04a9bc4f-418c-4374-b1ef-38679e56bcfd tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.199411 Jun 20 11:04:58.800960 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 28/65] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:58 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:59.051058 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:59.052036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:59.058129 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:59.058800 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:59.059559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:59.060302 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:59.211578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:04:59.221628 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-77ddfe85-34d1-4c1f-8f1d-01e5c96a7813 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.174181 Jun 20 11:04:59.222320 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 38/66] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:59 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:04:59.473626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:59.475119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:59.493227 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:59.493829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:59.494796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:59.495450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:59.818462 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:04:59.821020 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:04:59.832908 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:59.837413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:59.840338 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:04:59.840875 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:04:59.948882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:00.114751 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:00.124035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4daf652f-ddd4-42d6-9026-83c8815d42f5 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.309984 Jun 20 11:05:00.125160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 39/67] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:59 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:00.211245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:00.219419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5397479a-90ad-4ad2-99a6-64c6aa89f9ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.752368 Jun 20 11:05:00.220512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 29/68] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:04:59 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:00.241191 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:00.242377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:00.250377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:00.252562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:00.253191 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:00.254222 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:00.254668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:00.484732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:00.492996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-77d29650-d79d-47fe-b52e-3eba8c7c1594 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.257848 Jun 20 11:05:00.503557 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 40/69] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:00 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:00.649905 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-5bd1fed4-52e2-418d-b5f5-aeded0feebf4 req-a78ba6b6-7a6f-423f-a914-480cc867c68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9621402-810b-4546-8a08-d5c9aa06af9b", "name": "network-vif-plugged", "status": "completed", "tag": "75ab2497-b005-4e17-9787-c9657ebec80b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:00.666611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5bd1fed4-52e2-418d-b5f5-aeded0feebf4 req-a78ba6b6-7a6f-423f-a914-480cc867c68e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:00.667321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5bd1fed4-52e2-418d-b5f5-aeded0feebf4 req-a78ba6b6-7a6f-423f-a914-480cc867c68e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:00.695423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-5bd1fed4-52e2-418d-b5f5-aeded0feebf4 req-a78ba6b6-7a6f-423f-a914-480cc867c68e service nova] Creating event network-vif-plugged:75ab2497-b005-4e17-9787-c9657ebec80b for instance a9621402-810b-4546-8a08-d5c9aa06af9b on hv-cinder-84614 Jun 20 11:05:00.696700 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5bd1fed4-52e2-418d-b5f5-aeded0feebf4 req-a78ba6b6-7a6f-423f-a914-480cc867c68e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 11:05:00.699034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:00.700161 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:00.701599 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:00.702680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:00.718747 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.compute.rpcapi [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 11:05:00.720080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] Releasing lock "compute-rpcapi-router" {{(pid=117606) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 11:05:00.756708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41d76efe-6481-48ba-9775-a404a43da348 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320981 Jun 20 11:05:00.757375 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 30/70] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:05:01.142364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:01.143737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:01.149891 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:01.150365 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:01.151154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:01.151577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:01.240642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:01.242868 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:01.249884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:01.250687 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:01.251634 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:01.253019 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:01.308815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:01.317619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-20ae9871-8b81-4af6-b630-1689b1326869 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.179077 Jun 20 11:05:01.329362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 41/71] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:01 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:01.395639 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:01.403683 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a618a11c-ed1d-4d23-abb9-38768ca3802c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.170041 Jun 20 11:05:01.404431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 31/72] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:01 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:01.511868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:01.512508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:01.519358 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:01.519803 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:01.520778 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:01.521207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:01.679404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:01.691162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b5f93ed9-225d-4456-bdf1-6ded69cc2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.184263 Jun 20 11:05:01.692081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 42/73] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:01 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:02.336540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:02.337103 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:02.344816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:02.345040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:02.346957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:02.347985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:02.420388 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:02.421017 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:02.427883 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:02.428584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:02.429516 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:02.430115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:02.564276 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:02.574603 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9b5e3176-33b2-4cf5-b99d-4ec82ed3e327 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.242748 Jun 20 11:05:02.584652 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 32/74] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:02 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:02.618471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:02.626810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bbeef705-c12f-4ecd-98b1-e51603688b8f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.210377 Jun 20 11:05:02.627377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 43/75] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:02 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:02.710960 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:02.712142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:02.718890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:02.719336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:02.720097 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:02.720690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:02.864151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:02.872334 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b18475a4-77f2-4ee3-93e2-cf0915312292 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.167099 Jun 20 11:05:02.873137 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 33/76] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:02 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:03.593804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:03.594605 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:03.600824 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:03.601794 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:03.602582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:03.603180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:03.647336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:03.649003 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:03.660294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:03.661067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:03.662417 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:03.664755 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:03.834228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:03.844728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ba6b186d-10e4-47f4-b6d3-ed88280abbc2 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.256212 Jun 20 11:05:03.845490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 44/77] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:03 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:03.881064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:03.890749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77db3a57-8438-4efe-a943-739db28e6b4f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.250338 Jun 20 11:05:03.891002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:03.891909 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:03.892319 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 34/78] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:03 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:03.900621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:03.902165 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:03.903325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:03.903899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:04.303582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:04.317583 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a6fcc92f-b558-4cdb-9eff-18b2456dc073 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.431779 Jun 20 11:05:04.324727 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 45/79] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:03 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:04.868946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:04.869684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:04.875927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:04.876491 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:04.877317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:04.877812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:04.908283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:04.909035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:04.920263 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:04.920716 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:04.921498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:04.921935 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:05.036907 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:05.046784 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e693c52-efd9-4155-acee-1803bc0cdb68 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.180341 Jun 20 11:05:05.055978 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 35/80] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:04 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:05.084675 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:05.095227 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a3a58c51-ed96-4f9d-af80-e69665e7936c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.190556 Jun 20 11:05:05.095940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 46/81] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:04 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:05.336601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:05.337405 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:05.344379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:05.345686 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:05.347882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:05.348565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:05.491558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:05.499807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5f3e131e-aa92-465e-b1b2-39b833b7a01a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.167945 Jun 20 11:05:05.500385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 36/82] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:05 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:06.063737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:06.064354 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:06.070854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:06.071520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:06.076946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:06.077513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:06.114644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:06.116309 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:06.141155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:06.141722 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:06.142633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:06.143013 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:06.227786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:06.236757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3bfe2a2a-0c06-476e-a851-8f6fd0078d01 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.176483 Jun 20 11:05:06.237984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 47/83] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:06 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:06.332428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:06.342222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b6f28632-02a6-4a64-a9eb-a2d06ed2d29f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.233095 Jun 20 11:05:06.343261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 37/84] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:06 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:06.517797 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:06.518495 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:06.525798 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:06.526575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:06.527788 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:06.529292 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:06.738756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:06.752285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9bd3ffe9-a0b4-47b7-aa53-0e516c587e7a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.238613 Jun 20 11:05:06.753044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 48/85] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:06 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:07.253424 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:07.254036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:07.269693 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.270168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:07.270955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.271384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:07.362935 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:07.364943 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:07.373223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.375360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:07.376904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.377617 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:07.441626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:07.450156 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca19261f-ff86-4c26-a83d-7e9b8c332c41 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.200571 Jun 20 11:05:07.450760 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 38/86] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:07 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:07.476460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-905f2137-3c2c-4a64-a154-47c156101486 req-982735fe-1dc9-41ba-8561-fc4ac6143e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd1d65c-bf4a-4973-97ca-7263bd5e6dde", "name": "network-vif-plugged", "status": "completed", "tag": "5ba94606-ffa2-4ad9-96db-221a22bbb4b4"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:07.485802 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-905f2137-3c2c-4a64-a154-47c156101486 req-982735fe-1dc9-41ba-8561-fc4ac6143e3d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.486266 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-905f2137-3c2c-4a64-a154-47c156101486 req-982735fe-1dc9-41ba-8561-fc4ac6143e3d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:07.499660 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-905f2137-3c2c-4a64-a154-47c156101486 req-982735fe-1dc9-41ba-8561-fc4ac6143e3d service nova] Creating event network-vif-plugged:5ba94606-ffa2-4ad9-96db-221a22bbb4b4 for instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde on hv-cinder-84614 Jun 20 11:05:07.505632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-905f2137-3c2c-4a64-a154-47c156101486 req-982735fe-1dc9-41ba-8561-fc4ac6143e3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Jun 20 11:05:07.506902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 39/87] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:05:07.580659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:07.589899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4da409d6-f9e8-441b-9c00-5f306f07422c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.234272 Jun 20 11:05:07.591106 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 49/88] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:07 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:07.769271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:07.769975 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:07.778944 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.779381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:07.799419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:07.799864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:08.313474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:08.327806 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d1d2ef4b-100b-4d1c-8aea-b7fc5dd65d06 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.562642 Jun 20 11:05:08.328453 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 40/89] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:07 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:08.467502 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:08.468096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:08.474748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:08.476349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:08.477433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:08.477874 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:08.610369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:08.612360 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:08.625524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:08.630701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:08.633579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:08.634787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:08.729397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:08.740340 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-35cfda05-67f4-4082-baf5-70541bdaa564 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.276999 Jun 20 11:05:08.741277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 50/90] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:08 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:08.945356 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:08.953320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-105b007e-baec-471e-b9df-cd9d5585e623 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.349114 Jun 20 11:05:08.954231 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 41/91] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:08 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:09.345163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:09.345783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:09.355382 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:09.356043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:09.356954 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:09.362074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:09.529979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:09.543679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dfe9d5c5-1c27-4880-86f2-7da69e6a3ee8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.202340 Jun 20 11:05:09.556012 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 51/92] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:09 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:09.757025 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:09.757672 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:09.764629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:09.765063 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:09.765807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:09.766415 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:09.955987 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:09.965231 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30024384-ebc3-47cf-b55d-471176cc9f78 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.212010 Jun 20 11:05:09.965811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 42/93] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:09 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:09.970067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:09.970706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:09.978142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:09.978587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:09.979375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:09.980117 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:10.180162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:10.189484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-80f76ca8-11d9-4b52-b493-fe6f53aa18f9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.223170 Jun 20 11:05:10.191680 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 52/94] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:09 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:10.562928 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:10.563770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:10.570924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:10.571617 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:10.572668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:10.573302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:10.717029 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:10.798224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:10.814915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b5ee544f-1477-4e2f-afec-3a4440fae7ea tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.256989 Jun 20 11:05:10.815504 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 43/95] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:10 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:10.983787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:10.985236 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:10.997068 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:10.997514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:10.998323 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:10.998749 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:11.048979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:11.176948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:11.185718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f0d506e3-bca9-4d35-8294-fb7d18381bcb tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.207151 Jun 20 11:05:11.186525 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 53/96] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:10 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:11.207792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:11.208779 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:11.216443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:11.216973 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:11.217950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:11.218406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:11.457938 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:11.472626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7aaf5cb0-1455-4ce3-903c-17db5c3cce10 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.269826 Jun 20 11:05:11.474861 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 44/97] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:11 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:11.538418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-dc181d84-fc37-4fbd-ae36-1da54ad9de62 req-35694266-c97e-4430-93c6-8b52a9553e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe316d92-1158-4b44-b5c6-1c7c37e4c10d", "name": "network-vif-plugged", "status": "completed", "tag": "6416c894-1760-4713-ad6f-e0a40d7e0789"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:11.560963 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-dc181d84-fc37-4fbd-ae36-1da54ad9de62 req-35694266-c97e-4430-93c6-8b52a9553e04 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:11.564319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-dc181d84-fc37-4fbd-ae36-1da54ad9de62 req-35694266-c97e-4430-93c6-8b52a9553e04 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:11.590258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-dc181d84-fc37-4fbd-ae36-1da54ad9de62 req-35694266-c97e-4430-93c6-8b52a9553e04 service nova] Creating event network-vif-plugged:6416c894-1760-4713-ad6f-e0a40d7e0789 for instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d on hv-cinder-84614 Jun 20 11:05:11.597618 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-dc181d84-fc37-4fbd-ae36-1da54ad9de62 req-35694266-c97e-4430-93c6-8b52a9553e04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066474 Jun 20 11:05:11.598474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 54/98] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:05:11.833173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:11.833961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:11.841641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:11.842346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:11.843290 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:11.843972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:11.848317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:12.079309 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:12.088340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-751fb2e5-1689-4841-8530-325747145e8c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.259399 Jun 20 11:05:12.098819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 45/99] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:11 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:12.204188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:12.204784 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:12.211082 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:12.212156 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:12.212925 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:12.213616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:12.371533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:12.389114 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3a6984d5-6e9c-4cf6-8c40-990653ebfadf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1315 microversion: 2.1 time: 0.187076 Jun 20 11:05:12.389955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 55/100] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:12 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:12.492315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:12.493112 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:12.500768 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:12.501484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:12.502080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:12.502537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:12.652185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:12.660895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd1f2556-465e-4e64-ba12-cd0e71743901 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1321 microversion: 2.1 time: 0.172998 Jun 20 11:05:12.661550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 46/101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:12 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:13.105498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:13.106132 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:13.112375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.112745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.113752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.114164 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.274409 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:13.282650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2a45f636-0a13-4523-9a6a-7a145a9dd8b2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.181019 Jun 20 11:05:13.292523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 56/102] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:13 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:13.406494 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:13.407150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:13.414703 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.415158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.418271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.420966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.656642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:13.667883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-674c73d1-33ec-4626-8070-92f161124c47 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1503 microversion: 2.1 time: 0.265481 Jun 20 11:05:13.668478 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 47/103] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:13 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:13.682061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:13.682797 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:13.689560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.690260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.691832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.695941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.855509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:13.864196 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5164062c-0a62-4fa9-a2ca-7c4f0195315b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1514 microversion: 2.1 time: 0.189993 Jun 20 11:05:13.865011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 57/104] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:13 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:13.896815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:13.898366 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:13.906975 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.907778 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:13.908569 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:13.909078 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:14.017528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lazy-loading 'flavor' on Instance uuid abd1d65c-bf4a-4973-97ca-7263bd5e6dde {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:05:14.230663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4bbd3b36-1d15-4dcd-95a2-22dfdb3766fb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde/action" status: 200 len: 32 microversion: 2.1 time: 0.352463 Jun 20 11:05:14.235766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 48/105] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:05:13 2022] POST /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 11:05:14.240284 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:14.240894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:14.249048 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:14.249968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:14.252608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:14.253459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:14.303321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:14.304352 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:14.323900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:14.324860 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:14.327647 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:14.330953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:14.461652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:14.484307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-06da8f0e-99d4-4f4d-a27c-54e5cbab6635 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.247618 Jun 20 11:05:14.494790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 58/106] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:14 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:14.765165 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:14.779329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8997a05d-4fe9-4d61-b680-7a33ed09f1e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.481570 Jun 20 11:05:14.789742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 49/107] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:14 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:15.270497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17a33473-dc82-409e-95f2-5b925a71d5e6"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:15.272052 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:15.279212 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.279651 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.280445 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.280872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.502367 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:15.502987 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:15.511424 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.511885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.512697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.514238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.804855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:15.820216 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b24eb4d0-76a2-49e6-a070-bd66c7e19bd0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.321035 Jun 20 11:05:15.821323 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 50/108] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:15 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:15.828785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:15.829392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:15.840959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.841382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.842327 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.842755 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.949540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b14d0373-b569-4a77-b165-d39ba6db8ecc tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "POST /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683038 Jun 20 11:05:15.955499 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 59/109] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:05:15 2022] POST /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:05:15.961372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-d9184699-8dc7-4a94-8a63-de1d78c09266 req-90b724fc-a6f6-45e5-ade3-e385f74285fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8963e2f6-7da5-4629-83bf-1ee968229650", "name": "network-vif-plugged", "status": "completed", "tag": "d17429a4-6d58-49e4-ad27-780b92838339"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:15.971609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d9184699-8dc7-4a94-8a63-de1d78c09266 req-90b724fc-a6f6-45e5-ade3-e385f74285fa service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:15.972404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d9184699-8dc7-4a94-8a63-de1d78c09266 req-90b724fc-a6f6-45e5-ade3-e385f74285fa service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:15.984364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-d9184699-8dc7-4a94-8a63-de1d78c09266 req-90b724fc-a6f6-45e5-ade3-e385f74285fa service nova] Creating event network-vif-plugged:d17429a4-6d58-49e4-ad27-780b92838339 for instance 8963e2f6-7da5-4629-83bf-1ee968229650 on hv-cinder-84614 Jun 20 11:05:15.990470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-d9184699-8dc7-4a94-8a63-de1d78c09266 req-90b724fc-a6f6-45e5-ade3-e385f74285fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Jun 20 11:05:15.992043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 60/110] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:05:16.022141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:16.031993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d93cd12e-115d-4d53-b3c5-51219d7f230c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1362 microversion: 2.1 time: 0.209395 Jun 20 11:05:16.032605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 51/111] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:15 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:16.849544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:16.850688 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:16.859963 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:16.860505 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:16.861337 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:16.861968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:17.029108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:17.040968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-78e05682-55bf-4c91-b7fa-2e5bad6f3ac1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.198608 Jun 20 11:05:17.044454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 61/112] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:16 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:17.049821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:17.050739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:17.057766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:17.058222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:17.058997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:17.059486 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:17.264814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:17.273065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3939b83f-8ad9-480c-859b-f268a91b1c3f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1548 microversion: 2.1 time: 0.228111 Jun 20 11:05:17.278153 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 52/113] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:17 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:17.290438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:17.291028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:17.297873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:17.298457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:17.299333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:17.299841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:17.380870 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0a383acb-033e-4482-b828-cd8d031eb889 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094409 Jun 20 11:05:17.381557 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 62/114] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:05:17 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:05:18.067080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:18.067712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:18.075423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:18.076531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:18.077377 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:18.077995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:18.504649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:18.512791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b3b4b37b-745e-474c-bddf-f5d68ce2ccfa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.449663 Jun 20 11:05:18.513618 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 53/115] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:18 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:18.879295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-1ce8d9d6-8035-463d-bc25-e0e666362b05 req-c56d0f42-69a2-4706-a775-2062fb878cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe316d92-1158-4b44-b5c6-1c7c37e4c10d", "tag": "6416c894-1760-4713-ad6f-e0a40d7e0789"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:18.888055 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-1ce8d9d6-8035-463d-bc25-e0e666362b05 req-c56d0f42-69a2-4706-a775-2062fb878cab service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:18.888488 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-1ce8d9d6-8035-463d-bc25-e0e666362b05 req-c56d0f42-69a2-4706-a775-2062fb878cab service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:18.900148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-1ce8d9d6-8035-463d-bc25-e0e666362b05 req-c56d0f42-69a2-4706-a775-2062fb878cab service nova] Creating event network-changed:6416c894-1760-4713-ad6f-e0a40d7e0789 for instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d on hv-cinder-84614 Jun 20 11:05:18.906601 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-1ce8d9d6-8035-463d-bc25-e0e666362b05 req-c56d0f42-69a2-4706-a775-2062fb878cab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031442 Jun 20 11:05:18.907420 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 63/116] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:05:19.545105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:19.546322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:19.553537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:19.554302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:19.555247 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:19.556392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:19.832243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:19.848685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5649390-5e7f-46ce-aa13-5f8a621c0194 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.312335 Jun 20 11:05:19.858372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 54/117] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:19 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:20.869104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:20.869806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:20.876293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:20.876757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:20.877515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:20.877946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:21.032814 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:21.041686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-12e9a72d-66f0-4d70-b64d-629f0d28071f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.179165 Jun 20 11:05:21.042326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 64/118] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:20 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:22.060092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:22.060697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:22.067132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:22.067573 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:22.068318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:22.068751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:22.203422 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:22.211074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ecea45c-6798-499c-9fa1-f614d9f5df33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.155762 Jun 20 11:05:22.211653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 55/119] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:22 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:23.231736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:23.232242 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:23.239288 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:23.239730 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:23.240486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:23.240928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:23.382466 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:23.390627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-303b1c5e-e2ac-44fe-af24-d20fbe6c4bd8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.164752 Jun 20 11:05:23.391204 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 65/120] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:23 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:24.407609 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:24.408188 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:24.414631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:24.415070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:24.415811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:24.416242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:24.549695 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:24.557877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-56ad29cb-7542-49a2-b080-f5660422602c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.154074 Jun 20 11:05:24.558483 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 56/121] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:24 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:25.576031 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:25.576610 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:25.583436 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:25.583884 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:25.584643 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:25.585071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:25.724442 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:25.736253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ab39c3b8-195f-4d12-b580-b4fff2c3f529 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.164040 Jun 20 11:05:25.737013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 66/122] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:25 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:26.757120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:26.757832 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:26.764177 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:26.764696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:26.765853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:26.766296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:26.905325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:26.914141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5c9cfef-c348-4d02-bd71-49d0831cef6e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.159979 Jun 20 11:05:26.914141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 57/123] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:26 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:27.931300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:27.933373 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:27.941193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:27.941719 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:27.942590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:27.943213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:28.079243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:28.087070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f1a1c42b-5c6c-4bdb-97ae-30be515b1e9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.161810 Jun 20 11:05:28.087649 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 67/124] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:27 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:29.108141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:29.109021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:29.111989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=60 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:29.120529 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:29.121208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:29.122425 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:29.123091 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:29.281951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:29.289770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54516a9b-1027-48fa-ab0c-d86e16cd8e65 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.187716 Jun 20 11:05:29.290384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 58/125] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:29 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:29.950721 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:29.951839 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:29.959901 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:29.960344 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:29.961180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:29.961537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:29.989107 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:05:30.086923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-60d0d8b8-3102-4191-be16-c50c227d99f4 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 204 len: 0 microversion: 2.1 time: 0.140475 Jun 20 11:05:30.087570 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 68/126] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:05:29 2022] DELETE /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:05:30.097540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:30.098170 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:30.104467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:30.104942 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:30.106184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:30.106690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:30.292878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:30.296407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:30.302108 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb3d5bd1-a295-4ce0-a712-d4c8eedc1b7a tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1555 microversion: 2.1 time: 0.210052 Jun 20 11:05:30.302834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 59/127] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:30 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:30.308408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:30.309463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:30.312949 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:30.317040 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:30.317552 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:30.318502 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:30.318953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:30.327707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:30.533972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:30.542386 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-076ffec7-0fba-44b1-ba60-dfcf4db01a8c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.238160 Jun 20 11:05:30.553211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 69/128] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:30 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:31.320922 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:31.322262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:31.331834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:31.332363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:31.333497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:31.334032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:31.479551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:31.490487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7cf94095-03ef-4581-9930-1e19fd81daf7 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1555 microversion: 2.1 time: 0.174761 Jun 20 11:05:31.491926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 60/129] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:31 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:31.559776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:31.560461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:31.573901 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:31.574684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:31.575756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:31.576865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:31.712587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:31.723733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c452583e-3e5b-468f-8173-8fffb9e577df tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.168169 Jun 20 11:05:31.724473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 70/130] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:31 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:32.514715 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:32.515472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:32.524523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:32.524937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:32.526132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:32.527263 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:32.719431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:32.728616 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-01b5b6fe-4c43-4a56-9390-17bf2ac4fbd0 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1555 microversion: 2.1 time: 0.223550 Jun 20 11:05:32.741413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:32.741950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 61/131] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:32 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:32.742250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:32.749285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:32.750345 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:32.751219 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:32.751657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:32.896861 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:32.904497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-784d0fd2-668b-4a67-b1b9-0eb7b676ab58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.167560 Jun 20 11:05:32.906120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 71/132] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:32 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:33.748517 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:33.749773 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:33.756369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:33.756798 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:33.757659 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:33.758120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:33.926146 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:33.926929 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:33.942022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:33.945250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:33.947144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:33.947805 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:34.021565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:34.039496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5ac60a13-45ac-4c98-a9c9-c5e88b099bdf tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1555 microversion: 2.1 time: 0.295335 Jun 20 11:05:34.046648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 62/133] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:33 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1555 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:34.131790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:34.145501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8a13f690-bddd-4899-ad19-4f43592e2481 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.226933 Jun 20 11:05:34.146553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 72/134] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:33 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:34.339483 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-ea5549ff-aede-4991-b915-b4b169c6a100 req-f7e2e25a-fa9c-4851-9585-770c4e218b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9621402-810b-4546-8a08-d5c9aa06af9b", "name": "network-vif-deleted", "tag": "75ab2497-b005-4e17-9787-c9657ebec80b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:34.358740 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ea5549ff-aede-4991-b915-b4b169c6a100 req-f7e2e25a-fa9c-4851-9585-770c4e218b80 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:34.360065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ea5549ff-aede-4991-b915-b4b169c6a100 req-f7e2e25a-fa9c-4851-9585-770c4e218b80 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:34.377423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-ea5549ff-aede-4991-b915-b4b169c6a100 req-f7e2e25a-fa9c-4851-9585-770c4e218b80 service nova] Creating event network-vif-deleted:75ab2497-b005-4e17-9787-c9657ebec80b for instance a9621402-810b-4546-8a08-d5c9aa06af9b on hv-cinder-84614 Jun 20 11:05:34.384531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-ea5549ff-aede-4991-b915-b4b169c6a100 req-f7e2e25a-fa9c-4851-9585-770c4e218b80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055178 Jun 20 11:05:34.386458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 63/135] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:05:35.068309 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:35.070132 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:35.078616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:35.079824 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:35.080873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:35.081531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:35.119585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:35.120491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:35.120823 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lazy-loading 'fault' on Instance uuid a9621402-810b-4546-8a08-d5c9aa06af9b {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:05:35.163968 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:35.165256 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:35.172238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:35.173204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:35.174040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:35.174715 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:35.201274 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14d3e513d8ce4efc87a359e04a77f05b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e27652a0a2f4421aed586e23a86d0ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:35.214649 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-15b6f854-7019-48f4-800e-fccc0aa1eb8e tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 200 len: 1351 microversion: 2.1 time: 0.153639 Jun 20 11:05:35.215249 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 73/136] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:35 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:35.326796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:35.334992 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6806a65f-2e5f-4007-85d0-b51b3f82caf1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.175836 Jun 20 11:05:35.335696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 64/137] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:35 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:36.236253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:36.236845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:36.243813 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:36.244257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:36.245024 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:36.245464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:36.259063 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] HTTP exception thrown: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Request method failure captured: Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b HTTP/1.1 Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ8wGdpNNTMjAnGcZ2HZfd7R42AKHeAs4nVBoJcxXr2l3KSlILJBL4XUu2VxRVpATmoYB20AvctO1gKuXAPK-z8fFbRkBH-Pi6NCAfWxr56WNldesH7g2d0GwKi9DhuCsGKjEj7EikITDsWACQfdCTAoPsU6-v0kUvA7C4Y9yx7VxM Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:05:36.263644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 14d3e513d8ce4efc87a359e04a77f05b Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.264981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'a9621402-810b-4546-8a08-d5c9aa06af9b'} Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:05:36.265806 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.267037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.268007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Returning 404 to user: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:05:36.268007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-34a85c00-5f52-4d16-b8d3-d4a78ef0f613 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 404 len: 111 microversion: 2.1 time: 0.035203 Jun 20 11:05:36.268007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 74/138] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:36 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:05:36.351992 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:36.352591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:36.358647 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:36.359097 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:36.359856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:36.360446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:36.372851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:36.373779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:36.380257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:36.380707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:36.381468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:36.382009 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:36.396302 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] HTTP exception thrown: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Request method failure captured: Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b/os-volume_attachments HTTP/1.1 Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ8wGdpNNTMjAnGcZ2HZfd7R42AKHeAs4nVBoJcxXr2l3KSlILJBL4XUu2VxRVpATmoYB20AvctO1gKuXAPK-z8fFbRkBH-Pi6NCAfWxr56WNldesH7g2d0GwKi9DhuCsGKjEj7EikITDsWACQfdCTAoPsU6-v0kUvA7C4Y9yx7VxM Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:05:36.398071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 14d3e513d8ce4efc87a359e04a77f05b Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.399503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'server_id': 'a9621402-810b-4546-8a08-d5c9aa06af9b'} Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:05:36.400258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:36.401482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:05:36.402888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Returning 404 to user: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:05:36.402888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f62af51f-836b-4f30-bc24-977364c8ed3f tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030754 Jun 20 11:05:36.403416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 75/139] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:05:36 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:05:36.494296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:36.503090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ebbcbed-9bcd-446f-af7a-9a00cfe6c93e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.154942 Jun 20 11:05:36.504168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 65/140] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:36 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:37.522224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:37.522849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:37.529379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:37.529825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:37.530626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:37.531056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:37.606931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:37.607965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:37.614702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:37.615764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:37.616673 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:37.617232 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:37.634067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] HTTP exception thrown: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Request method failure captured: Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b HTTP/1.1 Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ8wGdpNNTMjAnGcZ2HZfd7R42AKHeAs4nVBoJcxXr2l3KSlILJBL4XUu2VxRVpATmoYB20AvctO1gKuXAPK-z8fFbRkBH-Pi6NCAfWxr56WNldesH7g2d0GwKi9DhuCsGKjEj7EikITDsWACQfdCTAoPsU6-v0kUvA7C4Y9yx7VxM Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:05:37.639249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 14d3e513d8ce4efc87a359e04a77f05b Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.640935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a9621402-810b-4546-8a08-d5c9aa06af9b'} Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:05:37.641742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.643306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.644419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Returning 404 to user: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:05:37.644419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e3a8eb95-9208-4044-98f2-d70834d18fb3 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 404 len: 111 microversion: 2.1 time: 0.037760 Jun 20 11:05:37.644419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 66/141] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:05:37 2022] DELETE /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:05:37.651976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:37.652716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] [instance: a9621402-810b-4546-8a08-d5c9aa06af9b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:37.659582 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:37.660018 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:37.661035 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:37.662364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:37.677800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] HTTP exception thrown: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Request method failure captured: Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b HTTP/1.1 Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ8wGdpNNTMjAnGcZ2HZfd7R42AKHeAs4nVBoJcxXr2l3KSlILJBL4XUu2VxRVpATmoYB20AvctO1gKuXAPK-z8fFbRkBH-Pi6NCAfWxr56WNldesH7g2d0GwKi9DhuCsGKjEj7EikITDsWACQfdCTAoPsU6-v0kUvA7C4Y9yx7VxM Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:05:37.679359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e27652a0a2f4421aed586e23a86d0ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 1e27652a0a2f4421aed586e23a86d0ae Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-DeleteServersTestJSON-990199958 Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 14d3e513d8ce4efc87a359e04a77f05b Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-DeleteServersTestJSON-990199958-project Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.680485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'a9621402-810b-4546-8a08-d5c9aa06af9b'} Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:05:37.681230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. Jun 20 11:05:37.682258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:05:37.683219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] Returning 404 to user: Instance a9621402-810b-4546-8a08-d5c9aa06af9b could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:05:37.683219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b64700b-85a4-4445-b2e9-bcee7ee49f28 tempest-DeleteServersTestJSON-990199958 tempest-DeleteServersTestJSON-990199958-project] 10.222.0.33 "GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b" status: 404 len: 111 microversion: 2.1 time: 0.033479 Jun 20 11:05:37.698489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 67/142] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:37 2022] GET /compute/v2.1/servers/a9621402-810b-4546-8a08-d5c9aa06af9b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:05:37.722953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:37.734752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8ad80d90-b045-457d-85b8-d1ae8abd87b1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.216145 Jun 20 11:05:37.735600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 76/143] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:37 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:38.752589 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:38.753228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:38.760615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:38.761374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:38.762529 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:38.762965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:39.034681 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:39.046460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0fda5ae4-328f-4ae2-8835-730a964eb647 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.297828 Jun 20 11:05:39.047428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 68/144] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:38 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:40.071267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:40.074831 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:40.085669 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:40.086501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:40.103712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:40.105293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:40.442797 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:40.455283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b4e95d31-e121-4bcb-a905-2c9e21b80d33 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.394948 Jun 20 11:05:40.457945 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 77/145] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:40 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:41.474099 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:41.474743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:41.480950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:41.481410 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:41.482301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:41.482712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:41.650412 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:41.664062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f66294b-43e6-4ec8-8879-8e5f49b7578f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.193872 Jun 20 11:05:41.673427 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 69/146] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:41 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:42.682239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:42.682842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:42.689498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:42.689941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:42.690717 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:42.691131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:42.828963 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:42.836904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-94e4f3c5-c851-4b49-b913-ce0fd21c2633 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.159501 Jun 20 11:05:42.837564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 78/147] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:42 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:43.854462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:43.855090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:43.861291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:43.861739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:43.862528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:43.862966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:44.001986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:44.010168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1227b0b7-0817-45a8-9281-52969d9db09c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.159494 Jun 20 11:05:44.010905 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 70/148] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:43 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:45.031119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:45.032183 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:45.040685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:45.041132 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:45.041875 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:45.042339 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:45.179265 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:45.187219 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5d7548f0-505f-40b8-abde-f4783258c79e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.162669 Jun 20 11:05:45.187778 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 79/149] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:45 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:46.209101 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:46.209913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:46.217129 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:46.217600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:46.218431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:46.218886 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:46.354103 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:46.361835 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bbd80e7f-2de4-47a5-a852-2c9437f05d23 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.159461 Jun 20 11:05:46.362476 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 71/150] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:46 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:47.381281 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:47.381947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:47.391723 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:47.392514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:47.393584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:47.394324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:47.539563 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:47.548152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-089a9f4e-83f4-42c5-a69b-e810e6e73a50 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.172534 Jun 20 11:05:47.557560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 80/151] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:47 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:48.568121 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:48.568999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:48.578940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:48.579469 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:48.580539 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:48.581111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:48.718132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:48.726420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73e5394e-a73d-47df-84cd-ed8e1fe16240 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.164208 Jun 20 11:05:48.726990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 72/152] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:48 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:49.745847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:49.746377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:49.753480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:49.753955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:49.755077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:49.755574 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:49.892022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:49.899982 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0de067ce-f4dd-4b58-bdc8-91117d2dde04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.160316 Jun 20 11:05:49.900541 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 81/153] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:49 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:50.922033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:50.922448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:50.929695 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:50.930374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:50.931114 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:50.931770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:51.061552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:51.070358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99381d9f-61ac-4dc4-b799-ea7ef2f9717c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.155949 Jun 20 11:05:51.070937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 73/154] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:50 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:52.087682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:52.088190 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:52.095303 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:52.095756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:52.096520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:52.096952 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:52.244159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:52.252606 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-08c2158a-44d0-42af-a7f5-06ff91a78ec8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.169132 Jun 20 11:05:52.253151 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 82/155] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:52 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:52.951512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1444754188", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "networks": [{"uuid": "dbe44c05-2646-4c0b-9ae2-77381095b334"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:53.006511 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] validate_networks() for [('dbe44c05-2646-4c0b-9ae2-77381095b334', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:05:53.272183 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:53.273543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:53.280842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:53.281562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:53.282369 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:53.282801 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:53.396242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:05:53.396668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:05:53.397137 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:05:53.397544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:05:53.397951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:05:53.407141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:53.407588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:53.408373 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:53.408808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:53.424941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:53.426542 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Getting quotas for project d47c143cf33a41799202d5f7d90a66b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:05:53.430557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Getting quotas for user a96fa98fa00c4de29a9bed22ed9e597b and project d47c143cf33a41799202d5f7d90a66b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:05:53.432706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7051afad-083e-45f1-8fd3-5de68536a523 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.166942 Jun 20 11:05:53.433293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 83/156] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:53 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:53.442502 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:05:53.445146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:05:53.490431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3ab0be08-54a5-448b-82a9-d845740d5f61 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542678 Jun 20 11:05:53.491074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 74/157] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 11:05:53.501626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-10351fbe-b6d6-4e28-a0ae-0f1769bd3ef3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:53.502360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-10351fbe-b6d6-4e28-a0ae-0f1769bd3ef3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:53.554532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-10351fbe-b6d6-4e28-a0ae-0f1769bd3ef3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:53.561750 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-10351fbe-b6d6-4e28-a0ae-0f1769bd3ef3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1219 microversion: 2.1 time: 0.064221 Jun 20 11:05:53.562367 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 84/158] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:53 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:54.449670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:54.450392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:54.457026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:54.457478 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:54.458281 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:54.458701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:54.579468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:54.580163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:54.588192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:54.588714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:54.589564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:54.590071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:54.598202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:54.606534 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a23085b-ab68-4c85-a647-5fe50a8c7c60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.160666 Jun 20 11:05:54.607382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 75/159] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:54 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:54.657902 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:54.665643 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-84573404-876b-4223-9551-daf3b9e679df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1271 microversion: 2.1 time: 0.090232 Jun 20 11:05:54.666247 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 85/160] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:54 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:55.624478 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:55.625224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:55.631601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:55.632043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:55.632825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:55.633316 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:55.682933 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:55.683549 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:55.690241 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:55.690915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:55.691749 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:55.692116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:55.764044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:55.772212 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-28827af8-7b97-41d0-a939-a62695c6c372 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1271 microversion: 2.1 time: 0.093184 Jun 20 11:05:55.773093 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 86/161] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:55 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:55.778630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:55.786322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-317538fd-37ed-4840-ba18-cc7c6759bb27 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.166250 Jun 20 11:05:55.787442 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 76/162] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:55 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:56.789719 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:56.790468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:56.796601 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:56.798455 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:56.798455 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:56.798455 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:56.803772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:56.804496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:56.811150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:56.811957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:56.812845 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:56.813498 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:56.867995 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:56.872115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:56.878521 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-20f86656-0114-4deb-8d2f-0a8fee763eda tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1271 microversion: 2.1 time: 0.093372 Jun 20 11:05:56.879882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 87/163] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:56 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:56.953713 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:56.961637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-829c2fa1-aa60-4202-8c94-7e3031db9a94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.161597 Jun 20 11:05:56.962225 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 77/164] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:56 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:57.901138 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:57.902289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:57.927060 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:57.927582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:57.928596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:57.932527 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:57.985974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:57.987475 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:57.995126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:57.995574 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:57.996348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:57.996781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:58.035422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:58.048311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ecb2eed3-d149-4695-9747-aadb38a714cb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1279 microversion: 2.1 time: 0.154255 Jun 20 11:05:58.049451 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 88/165] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:57 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:58.220411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:58.228643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-97bdbd18-945e-4b6d-ba76-ee5eb11cfb51 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.250505 Jun 20 11:05:58.228870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 78/166] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:57 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:59.074790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:59.075871 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:59.083061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:59.083809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:59.084585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:59.085014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:59.243121 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:59.245488 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:05:59.246688 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:05:59.248718 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:59.251490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6fae3c05-3217-4eca-8c06-e66dc6733f19 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.188771 Jun 20 11:05:59.252153 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 89/167] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:59 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:05:59.254671 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:59.255314 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:59.256090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:59.256605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:59.263604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:05:59.486428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:05:59.510155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93fe3065-7875-4652-adb1-f75d94c42f37 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.268378 Jun 20 11:05:59.521680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 79/168] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:05:59 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:05:59.526281 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-f39e702e-91d0-4619-9779-11eb4915b764 req-07d9826c-f48e-4416-8d6a-140ee5a0c5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "554c0b82-5735-4eca-845d-0a777377b874", "tag": "90516466-9482-47d6-acdc-f524997026f2"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:05:59.535837 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-f39e702e-91d0-4619-9779-11eb4915b764 req-07d9826c-f48e-4416-8d6a-140ee5a0c5c2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:05:59.536645 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-f39e702e-91d0-4619-9779-11eb4915b764 req-07d9826c-f48e-4416-8d6a-140ee5a0c5c2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:05:59.549182 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-f39e702e-91d0-4619-9779-11eb4915b764 req-07d9826c-f48e-4416-8d6a-140ee5a0c5c2 service nova] Creating event network-changed:90516466-9482-47d6-acdc-f524997026f2 for instance 554c0b82-5735-4eca-845d-0a777377b874 on hv-cinder-84614 Jun 20 11:05:59.573441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-f39e702e-91d0-4619-9779-11eb4915b764 req-07d9826c-f48e-4416-8d6a-140ee5a0c5c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051619 Jun 20 11:05:59.574818 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 90/169] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:06:00.268963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:00.269772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:00.276476 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:00.276911 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:00.277660 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:00.278132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:00.415129 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:00.423303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7bfb6ff8-0651-4291-9847-09a97563fb79 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.158229 Jun 20 11:06:00.423978 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 80/170] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:00 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:00.528872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:00.529948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:00.532178 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=48 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:00.537817 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:00.538709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:00.539446 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:00.540082 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:00.687756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:00.696056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fd9f07e8-8519-4165-8e8b-3c7e8ac6ef34 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.172709 Jun 20 11:06:00.696740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 91/171] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:00 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:01.442765 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:01.443633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:01.453129 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:01.453800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:01.454996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:01.455659 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:01.617413 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:01.625940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bae304ed-b346-4061-ad08-99a18d869796 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.189561 Jun 20 11:06:01.626544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 81/172] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:01 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:01.714804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:01.715512 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:01.723779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:01.724325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:01.725481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:01.725990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:01.899252 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:01.910185 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8e19615a-1ac7-43b0-aa03-00039804716b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.200230 Jun 20 11:06:01.911275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 92/173] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:01 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:02.642341 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:02.643113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:02.651117 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:02.652919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:02.653789 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:02.654349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:02.790468 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:02.799758 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-140c0d35-5689-470a-bdaa-ccb5c8187f86 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.161297 Jun 20 11:06:02.800346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 82/174] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:02 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:02.927812 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:02.928450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:02.938323 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:02.938842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:02.939966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:02.941003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:03.081206 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:03.091663 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-04dd44ba-5dad-4a97-b3f4-466aa71dabce tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.167640 Jun 20 11:06:03.092766 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 93/175] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:02 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:06:03.818274 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:03.818691 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:03.821274 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:03.821952 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:03.828906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:03.829326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:03.830184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:03.830600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:03.989055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:03.999403 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e735efa6-f797-484b-ae38-5610322b44a8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.184636 Jun 20 11:06:04.002561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 83/176] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:03 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:04.109304 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:04.109859 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:04.111831 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:04.117619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:04.118061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:04.118834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:04.119261 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:04.264187 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:04.273122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a34897cc-8edd-4528-919e-675e51b55a93 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.167866 Jun 20 11:06:04.274437 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 94/177] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:04 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:05.015178 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:05.015864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:05.021977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:05.022462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:05.023223 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:05.023656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:05.166552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:05.176286 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31e10468-80ab-4604-ac23-698c2afa8900 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.164729 Jun 20 11:06:05.177167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 84/178] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:05 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:05.292683 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:05.293524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:05.300302 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:05.300849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:05.301692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:05.302221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:05.451598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:05.459453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-96c7a8f8-ecf2-49e0-bc09-e0e3efb96c3d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.171875 Jun 20 11:06:05.460035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 95/179] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:05 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:06.199341 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:06.200193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:06.211530 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:06.212141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:06.214620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:06.215245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:06.356001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:06.363450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d6b33e4-8f93-44cd-afff-40f283e090df tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.171947 Jun 20 11:06:06.364014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 85/180] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:06 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:06.402828 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-769ea488-3965-4caf-a8ab-447a30af8cdd req-7a74c366-7bc2-42ce-ae42-5718d50b5a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554c0b82-5735-4eca-845d-0a777377b874", "name": "network-vif-plugged", "status": "completed", "tag": "90516466-9482-47d6-acdc-f524997026f2"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:06:06.411848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-769ea488-3965-4caf-a8ab-447a30af8cdd req-7a74c366-7bc2-42ce-ae42-5718d50b5a38 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:06.412351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-769ea488-3965-4caf-a8ab-447a30af8cdd req-7a74c366-7bc2-42ce-ae42-5718d50b5a38 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:06.426272 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-769ea488-3965-4caf-a8ab-447a30af8cdd req-7a74c366-7bc2-42ce-ae42-5718d50b5a38 service nova] Creating event network-vif-plugged:90516466-9482-47d6-acdc-f524997026f2 for instance 554c0b82-5735-4eca-845d-0a777377b874 on hv-cinder-84614 Jun 20 11:06:06.436050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-769ea488-3965-4caf-a8ab-447a30af8cdd req-7a74c366-7bc2-42ce-ae42-5718d50b5a38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036860 Jun 20 11:06:06.437336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 96/181] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:06:06.486076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:06.487092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:06.497300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:06.497901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:06.498797 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:06.499421 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:06.705662 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:06.715773 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0422807e-7bb9-4ee2-927d-d58ea254e676 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.242769 Jun 20 11:06:06.716674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 86/182] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:06 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:07.381998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:07.382845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:07.389382 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:07.389910 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:07.390815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:07.391289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:07.532003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:07.539586 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d535c75c-149d-4f1f-8edb-b8641e40c2d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1319 microversion: 2.1 time: 0.162352 Jun 20 11:06:07.540142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 97/183] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:07 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:07.735210 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:07.735757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:07.742248 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:07.742693 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:07.743448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:07.743874 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:07.885046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:07.894921 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58051296-3270-4651-9c50-5d9dce277023 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.165252 Jun 20 11:06:07.895679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 87/184] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:07 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:08.556625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:08.557229 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:08.563979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:08.564435 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:08.565335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:08.565770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:08.708720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:08.719958 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-22b2a08f-8d32-4f3a-8ed8-65b6a4d17f09 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1507 microversion: 2.1 time: 0.167364 Jun 20 11:06:08.732391 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 98/185] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:08 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:08.913323 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:08.914144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:08.922484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:08.923769 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:08.924618 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:08.925055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:09.062785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:09.075288 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ef73cda-b540-45be-a266-d46117d0b4be tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.165755 Jun 20 11:06:09.076143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 88/186] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:08 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:10.097741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:10.098584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:10.105263 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:10.105679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:10.106486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:10.106985 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:10.238745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:10.246612 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bce2c7c6-5b07-451a-9136-34b56b3620d9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.152879 Jun 20 11:06:10.247179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 99/187] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:10 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:11.264277 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:11.265126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:11.271666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:11.272227 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:11.273064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:11.273557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:11.405678 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:11.414114 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3fad7eec-63c3-4533-92f2-d8bd654a6092 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.154500 Jun 20 11:06:11.414819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 89/188] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:11 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:12.431424 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:12.432014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:12.439287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:12.440041 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:12.440804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:12.441233 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:12.580832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:12.588542 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1ebd70f5-d391-4dd0-a3e0-770213a93898 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.161020 Jun 20 11:06:12.589102 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 100/189] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:12 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:13.604608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:13.608521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:13.613363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:13.613799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:13.614630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:13.615068 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:13.764172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:13.775588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e66964f-770c-4e37-9d91-a627fa1005f3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.174906 Jun 20 11:06:13.776206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 90/190] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:13 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:14.792965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:14.794258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:14.803459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:14.808754 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:14.810061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:14.810793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:14.981369 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:14.989593 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-760324d6-37e1-46db-bd71-a3235d84d733 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.200596 Jun 20 11:06:14.990221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 101/191] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:14 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:16.008300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:16.008876 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:16.015806 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:16.016256 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:16.017026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:16.017497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:16.218107 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:16.225957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e8feb82-9362-4016-98c2-7d502d0f8c72 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.221624 Jun 20 11:06:16.226746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 91/192] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:16 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:17.247019 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:17.248441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:17.274396 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:17.276499 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:17.278040 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:17.278727 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:17.515746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:17.526296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-af2d6152-dfbb-4a29-8f16-4300a7cb9dd1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.285894 Jun 20 11:06:17.537624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 102/193] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:17 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:18.545065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:18.545772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:18.552239 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:18.553401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:18.555833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:18.556274 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:18.702739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:18.712414 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff97bf89-6806-4217-be4d-38db619ee561 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.171630 Jun 20 11:06:18.714227 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 92/194] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:18 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:19.731888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:19.734193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:19.742244 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:19.743136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:19.744174 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:19.744842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:20.032855 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:20.041264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b84f4e6-c6f0-4884-bb59-8ef860f02455 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.313502 Jun 20 11:06:20.041945 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 103/195] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:19 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:21.058549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:21.059825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:21.067036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:21.067796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:21.069159 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:21.069804 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:21.293066 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:21.314725 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61e842e2-dffb-4b6e-92c4-50be12b7558f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.258684 Jun 20 11:06:21.315653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 93/196] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:21 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:22.339961 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:22.340700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:22.349287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:22.349807 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:22.350776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:22.351281 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:22.643103 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:22.651986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-81e11ff3-fe34-4bdd-a7ca-d8379e3f80c6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.322928 Jun 20 11:06:22.653342 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 104/197] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:22 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:23.669039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:23.670293 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:23.677581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:23.678284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:23.679271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:23.679960 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:23.904025 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:23.916999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-42322eea-231f-4532-835b-9f9beb0a7636 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.251652 Jun 20 11:06:23.917838 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 94/198] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:23 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:24.294999 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-54ef5a61-f127-4897-a7f9-2e547d926a32 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Action: 'create', calling method: .version_select at 0x7f7215379550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1558821828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd2S+rn83eF9vNPKV6pFsfqhYNRtuIAW+q8IfpO5rBfdAhgqmBHy6CR4aNOmicRUGnSVIZzXsd7uifSZMhzMSgAug7zlJaQd9rE6LAlAKx/lPRo8Jjbuu4BOpeBLy7DbA=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:06:24.309415 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-54ef5a61-f127-4897-a7f9-2e547d926a32 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for project 17bb5c3721fc4505a51879dae4762b43. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:06:24.313597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-54ef5a61-f127-4897-a7f9-2e547d926a32 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for user ee21ef9eacd24177a852f28d17376191 and project 17bb5c3721fc4505a51879dae4762b43. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:06:24.341497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-54ef5a61-f127-4897-a7f9-2e547d926a32 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.223230 Jun 20 11:06:24.342130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 105/199] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:06:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:06:24.935872 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:24.937189 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:24.944719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:24.945153 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:24.946556 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:24.947138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:25.101863 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:25.108469 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:25.116982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5ef84d2-0484-4fd6-b764-ff905b1fa555 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.186519 Jun 20 11:06:25.117825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 95/200] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:24 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:26.136714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:26.137353 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:26.145095 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:26.145600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:26.146378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:26.146878 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:26.287283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:26.290928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:26.296158 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7f7b3830-b7d2-426c-95d0-f8a17ea1674d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.163976 Jun 20 11:06:26.296730 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 106/201] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:26 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:27.317863 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:27.319055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:27.334264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:27.334687 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:27.335689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:27.336321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:27.479184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:27.487360 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-499070fc-24b6-4821-9f92-5fdf375c0ceb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.173635 Jun 20 11:06:27.487942 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 96/202] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:27 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:28.506000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:28.506670 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:28.514231 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:28.514746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:28.515586 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:28.516065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:28.676515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:28.684266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5c105f82-fe02-4d75-b63d-86cd0fcbc6c8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.182662 Jun 20 11:06:28.684840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 107/203] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:28 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:29.705018 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:29.705753 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:29.708362 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=36 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:29.716138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:29.716706 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:29.717718 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:29.718352 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:29.858126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:29.865962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffb0229a-436b-40d0-9110-871f9d122405 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.167138 Jun 20 11:06:29.866552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 97/204] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:29 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:30.885127 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:30.886150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:30.889752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:30.900250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:30.901082 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:30.902516 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:30.903169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:31.065148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:31.073680 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5503f1d2-7040-47db-a064-5e7ae3b9dca5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.193936 Jun 20 11:06:31.084438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 108/205] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:30 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:32.091492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:32.092118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:32.098857 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:32.099506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:32.100676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:32.100999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:32.305336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:32.314405 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0d392bfe-4991-4820-a4a9-4ae7d8548b96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.226503 Jun 20 11:06:32.314883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 98/206] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:32 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:33.334953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:33.335579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:33.342441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:33.342892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:33.343687 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:33.344114 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:33.524408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:33.535147 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3209fe8a-0c65-4cff-80d8-99da2b4b86f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1520 microversion: 2.1 time: 0.206137 Jun 20 11:06:33.535826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 109/207] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:33 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:34.557261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:34.557815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:34.564349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:34.564796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:34.565558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:34.565984 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:34.719347 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:34.727276 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e55c3d9c-c377-42c1-9e42-b26ac5c5c46c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1500 microversion: 2.1 time: 0.174018 Jun 20 11:06:34.727825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 99/208] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:34 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1500 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:34.745041 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:34.745649 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:34.747552 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:34.753403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:34.753845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:34.754636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:34.755058 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:34.894995 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:34.904316 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cf5a2435-aa26-48bb-8f7d-614f2b7afce9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1512 microversion: 2.1 time: 0.163927 Jun 20 11:06:34.904921 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 110/209] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:34 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:36.337463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:06:36.338577 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:36.346846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:36.347449 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:36.348233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:36.348664 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:36.376537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lazy-loading 'flavor' on Instance uuid 8963e2f6-7da5-4629-83bf-1ee968229650 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:06:36.456496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e5455ee-e120-4999-b497-58a6a9a927d3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/action" status: 200 len: 32 microversion: 2.1 time: 0.123166 Jun 20 11:06:36.457096 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 100/210] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:06:36 2022] POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:06:36.467401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:36.468008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:36.475055 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:36.475495 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:36.476352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:36.476809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:36.630097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:36.639913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4a418c84-8efb-4989-b134-d72a0de28f24 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.176140 Jun 20 11:06:36.641171 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 111/211] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:36 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:37.659577 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:37.660272 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:37.666957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:37.667393 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:37.668195 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:37.668551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:37.827909 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:37.835685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9313b2ad-e547-461e-9195-aee1621c4222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.180529 Jun 20 11:06:37.836252 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 101/212] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:37 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:38.853153 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:38.853751 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:38.861404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:38.861854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:38.862654 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:38.863087 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:39.011426 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:39.019614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-19994e79-e393-4d3f-a6c6-71c6f72f56ac tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.170456 Jun 20 11:06:39.020189 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 112/213] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:38 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:40.044108 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:40.045048 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:40.052581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:40.053027 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:40.053774 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:40.054224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:40.195339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:40.203464 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fbdb7376-e6c4-4388-949a-27c414c75eb0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.165775 Jun 20 11:06:40.204124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 102/214] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:40 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:41.224349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:41.225033 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:41.235105 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:41.235742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:41.236583 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:41.237014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:41.378329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:41.386119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-be00142e-c5f6-482c-8fcb-9727a01f4599 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.167890 Jun 20 11:06:41.386743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 113/215] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:41 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:42.403683 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:42.404281 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:42.410750 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:42.411203 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:42.411977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:42.412412 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:42.558335 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:42.566540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b8c0a17d-3089-4c3f-ad9d-8b14ee26ce11 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.166729 Jun 20 11:06:42.567224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 103/216] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:42 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:43.585473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:43.586077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:43.592893 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:43.593339 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:43.594062 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:43.594839 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:43.728787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:43.736488 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8de00c6b-844e-4572-a0a2-d2f5a30ed400 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.154947 Jun 20 11:06:43.737067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 114/217] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:43 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:44.754588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:44.755282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:44.761757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:44.762274 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:44.762930 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:44.763363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:44.901064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:44.909273 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-abe8108f-76bc-40b5-95a5-f69ec63e656a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.159412 Jun 20 11:06:44.910319 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 104/218] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:44 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:45.929394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:45.930006 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:45.936668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:45.937120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:45.937876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:45.938372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:46.069734 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:46.077425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4a075339-e7ca-4a27-96a8-8ea6505fdfae tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.152669 Jun 20 11:06:46.077916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 115/219] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:45 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:47.094283 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:47.094893 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:47.101979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:47.102449 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:47.103239 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:47.103629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:47.247177 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:47.257490 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b30be166-70db-4723-a60b-0ce46ec465cb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.167081 Jun 20 11:06:47.258123 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 105/220] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:47 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:48.275463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:48.276061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:48.283155 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:48.283608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:48.284364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:48.284821 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:48.429682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:48.440660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a70757b5-bf52-40da-bb7b-87989b84cb14 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.168885 Jun 20 11:06:48.441382 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 116/221] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:48 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:49.458581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:49.459142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:49.466543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:49.466989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:49.467765 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:49.468184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:49.605968 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:49.615406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb4b47a4-5410-49fc-974f-b826d4c485f8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.160726 Jun 20 11:06:49.616000 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 106/222] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:49 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:50.632818 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:50.633518 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:50.641205 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:50.641657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:50.642493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:50.643123 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:50.829571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:50.837740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9613ccd9-5330-43f9-bb0a-64b22370478c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.209117 Jun 20 11:06:50.838345 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 117/223] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:50 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:51.854560 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:51.855199 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:51.861512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:51.861941 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:51.862797 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:51.863326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:52.011207 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:52.019166 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ecc1e6bd-1278-4101-a2d6-09e447cf4860 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.168473 Jun 20 11:06:52.019826 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 107/224] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:51 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:53.036188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:53.036899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:53.043853 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:53.044304 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:53.045064 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:53.045483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:53.188556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:53.200325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9cba53f-c437-4acd-b49e-1b1e955cff7a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.167903 Jun 20 11:06:53.200910 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 118/225] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:53 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:54.216789 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:54.217401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:54.223804 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:54.224259 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:54.225034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:54.225467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:54.367397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:54.375207 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8369eb71-fec8-49e8-b917-b4c79ad3e26f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.162368 Jun 20 11:06:54.375783 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 108/226] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:54 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:55.392660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:55.393366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:55.401900 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:55.402427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:55.403343 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:55.403852 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:55.554211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:55.562651 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0763440c-d167-45a2-9a28-d4e3175c62cd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.174045 Jun 20 11:06:55.563241 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 119/227] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:55 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:56.581900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:56.582509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:56.588944 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:56.589387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:56.590167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:56.590791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:56.593505 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:56.735381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:56.745323 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e65c322f-0464-433f-86bf-65ff24e70a4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.164899 Jun 20 11:06:56.745323 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 109/228] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:56 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:57.760874 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:57.761619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:57.768348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:57.768794 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:57.769542 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:57.770003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:57.772561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=79 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:06:57.909714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:57.918127 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8ddfe741-54f2-4d3e-9613-2e7cbdb47893 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.161264 Jun 20 11:06:57.918872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 120/229] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:57 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:06:58.935379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:06:58.936015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:06:58.942043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:58.942520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:58.943635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:06:58.944063 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:06:59.100622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:06:59.110696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73c6f4d0-a428-4276-88f7-c7c283c4e062 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.179415 Jun 20 11:06:59.116240 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 110/230] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:06:58 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:00.132931 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:00.133735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:00.141472 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:00.141946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:00.142790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:00.143243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:00.275695 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:00.283690 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-98e7bbd1-a1b0-4049-afb8-b420e91a282b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.157454 Jun 20 11:07:00.284244 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 121/231] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:00 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:01.300902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:01.301521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:01.303552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=28 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:01.309349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:01.309793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:01.310576 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:01.311001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:01.495646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:01.504671 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6f081443-011b-4428-ba81-aef2b19a8bad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.207279 Jun 20 11:07:01.506148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 111/232] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:01 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:02.522600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:02.523154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:02.525480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=28 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:02.531108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:02.531545 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:02.532296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:02.532730 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:02.829273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:02.837080 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f0dcc14b-7e6c-436f-b9d7-95703e88b57d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.318501 Jun 20 11:07:02.837646 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 122/233] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:02 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:03.855148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:03.856257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:03.862407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:03.862848 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:03.863598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:03.864031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:03.998802 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:04.006906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2f95c16f-f889-496d-b429-f62e1f9fe7ca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.155675 Jun 20 11:07:04.016521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 112/234] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:03 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:05.024602 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:05.026153 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:05.034578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:05.035140 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:05.035915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:05.036479 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:05.183795 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:05.193232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e519d58a-2cbb-4585-9a5e-64da133e9d94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.172634 Jun 20 11:07:05.193881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 123/235] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:05 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:06.210342 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:06.211119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:06.217663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:06.218123 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:06.218877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:06.222230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:06.351883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:06.359920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6d4c5dc-84a1-40f9-b4a8-0ece1afa26ed tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.153610 Jun 20 11:07:06.360485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 113/236] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:06 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:07.376782 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:07.377425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:07.383994 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:07.384433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:07.385201 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:07.385815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:07.524030 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:07.532138 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-03fd9b28-a4ef-4333-b374-5812c81e31c2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.159243 Jun 20 11:07:07.532787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 124/237] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:07 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:08.549010 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:08.550189 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:08.558374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:08.558842 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:08.559764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:08.560369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:08.691822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:08.699986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5c5f9867-7784-4ce3-87ca-ad0bf177224e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.154927 Jun 20 11:07:08.700554 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 114/238] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:08 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:09.719065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:09.719807 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:09.727743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:09.728242 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:09.729079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:09.729781 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:09.869422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:09.877164 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4d432766-64e3-4983-93b8-d3d855381a1f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1498 microversion: 2.1 time: 0.163709 Jun 20 11:07:09.877729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 125/239] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:09 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:09.893977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e736e62-9e2d-42a0-87d7-8f3afd4858a9"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:09.895079 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:09.901292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:09.901815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:09.902707 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:09.903134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:09.927631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] HTTP exception thrown: Cannot 'attach_volume' instance 8963e2f6-7da5-4629-83bf-1ee968229650 while it is in vm_state rescued Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Request method failure captured: Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/os-volume_attachments HTTP/1.1 Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ_azYavfpigFciMQdM673oO9M66LVlpfO6vi7JL7r0LFufoaT1eEo1Dp0ARIxFX3dsQ3eOG3gEcrSgZGaM7cMjLoetGkR1t0c8Ll8rEeLGLCoDJWdgjU1bagtAIwcAfQ3AE4eoc0RQSN5PWNrwAu38__EiGThC8z8ETCVlSIfvb_w Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:07:09.929816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 0c4a4ce86beb47c2b7910264a9238c8b Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "1e736e62-9e2d-42a0-87d7-8f3afd4858a9"}} Jun 20 11:07:09.931291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Cannot 'attach_volume' instance 8963e2f6-7da5-4629-83bf-1ee968229650 while it is in vm_state rescued Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '8963e2f6-7da5-4629-83bf-1ee968229650', 'body': {'volumeAttachment': {'volumeId': '1e736e62-9e2d-42a0-87d7-8f3afd4858a9'}}} Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:07:09.932162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8963e2f6-7da5-4629-83bf-1ee968229650 while it is in vm_state rescued Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:07:09.933443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8963e2f6-7da5-4629-83bf-1ee968229650 while it is in vm_state rescued Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Returning 409 to user: Cannot 'attach_volume' instance 8963e2f6-7da5-4629-83bf-1ee968229650 while it is in vm_state rescued {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c92b853c-d29c-4506-923e-118690646ce4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041312 Jun 20 11:07:09.934947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 115/240] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:07:09 2022] POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:07:09.943579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:09.944368 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:09.951880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:09.952335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:09.953111 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:09.953548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:10.022718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f38ce9d9-0462-465c-9276-f3add6b34215 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/action" status: 202 len: 0 microversion: 2.1 time: 0.085468 Jun 20 11:07:10.024159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 126/241] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:07:09 2022] POST /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:07:10.033476 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:10.034105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:10.041360 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:10.041927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:10.042816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:10.043397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:10.261471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:10.269815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-72ad1102-fa98-43e7-8e27-fdac134ad435 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.240981 Jun 20 11:07:10.270461 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 116/242] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:10 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:10.907124 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "249286d3-3eca-4bad-86dc-ad6db4e82fb9", "device": "/dev/sdb"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:10.908843 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:10.915472 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:10.915920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:10.917312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:10.917312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:11.292053 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:11.292645 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:11.299306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:11.299760 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:11.300536 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:11.300964 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:11.437417 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:11.445519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a16a9501-fbe8-4b9a-8799-6b949f95e085 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.160031 Jun 20 11:07:11.446155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 117/243] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:11 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:12.467197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:12.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:12.478658 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:12.479525 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:12.480294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:12.480725 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:12.617905 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:12.626246 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0febf36-599c-4778-9a70-a0db18f094fd tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.166094 Jun 20 11:07:12.626819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 118/244] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:12 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:13.643680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:13.644314 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:13.650901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:13.651351 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:13.652200 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:13.652629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:13.785770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:13.793663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7ee7dd3-1d55-4500-af8e-f39862c3f866 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.153952 Jun 20 11:07:13.794287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 119/245] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:13 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:14.581448 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fbc20031-cb79-41a6-8cd2-d370731d0a2c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "POST /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.679074 Jun 20 11:07:14.582068 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 127/246] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:07:10 2022] POST /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874/os-volume_attachments => generated 194 bytes in 3681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:14.810386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:14.810997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:14.817460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:14.818291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:14.819049 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:14.819474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:14.953124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:14.963729 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d86a8ca7-b878-48b3-a537-59da8050ec69 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.157110 Jun 20 11:07:14.964587 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 120/247] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:14 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:15.983799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:15.984548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:15.991109 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:15.991555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:15.992301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:15.992766 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:16.137299 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:16.145253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-536a08ff-80e8-4023-b07b-45f93a94ebf7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.166800 Jun 20 11:07:16.145863 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 128/248] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:15 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:17.163260 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:17.163945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:17.170898 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:17.171413 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:17.172270 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:17.172787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:17.319203 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:17.327011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe9748c9-27d7-4249-af96-b1a3a7307bb9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1506 microversion: 2.1 time: 0.167638 Jun 20 11:07:17.327595 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 121/249] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:17 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:18.352953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:18.353828 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:18.365785 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:18.366630 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:18.367885 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:18.368597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:18.512813 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:18.520355 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f82942ba-3902-462c-93cb-466204c07162 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1512 microversion: 2.1 time: 0.176969 Jun 20 11:07:18.520907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 129/250] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:18 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:20.059619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-683631590", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1558821828", "security_groups": [{"name": "tempest-secgroup-smoke-1979074994"}], "block_device_mapping_v2": [{"uuid": "11a3624a-f163-40c6-871d-3b7221802b1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7129602-ccc0-484b-85f3-177744b5235e"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:20.193189 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] validate_networks() for [('f7129602-ccc0-484b-85f3-177744b5235e', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:07:20.577512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:07:20.578233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:07:20.578897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:07:20.579495 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:07:20.580373 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:07:20.592691 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:20.593102 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:20.593892 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:20.594370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:20.611537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for project 17bb5c3721fc4505a51879dae4762b43. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:07:20.616055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for user ee21ef9eacd24177a852f28d17376191 and project 17bb5c3721fc4505a51879dae4762b43. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:07:20.679758 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:07:20.683212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11a3624a-f163-40c6-871d-3b7221802b1a',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:07:20.828143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ec87372-e8ac-46cd-a855-4dac97951f69 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772015 Jun 20 11:07:20.829133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 122/251] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:07:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:07:20.841189 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-53573660-0fa2-4942-ad5c-4002a4637384 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:20.841788 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-53573660-0fa2-4942-ad5c-4002a4637384 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:20.899114 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-53573660-0fa2-4942-ad5c-4002a4637384 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:20.906326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-53573660-0fa2-4942-ad5c-4002a4637384 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1094 microversion: 2.1 time: 0.068955 Jun 20 11:07:20.915788 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 130/252] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:20 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:21.924239 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:21.924869 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:21.932260 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:21.932946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:21.933973 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:21.934538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:22.017638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:22.025537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-da11e957-6dd4-42c7-b608-4313239a6313 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1210 microversion: 2.1 time: 0.105658 Jun 20 11:07:22.026128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 123/253] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:21 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:22.031808 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d63f6485-fdb4-44d1-92aa-27305a340183 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'create', calling method: .version_select at 0x7f72153d6670>, body: {"keypair": {"name": "tempest-keypair-531437473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ45bDYEN93kTkWZtvKk8YOnKmbVYctvMzg7GL/Tgo5QyNdeu9rct7uUslWb8fW5QTg9d+sAYWNBdfkCsVg0EeuKm08hIGlZsKkO90ldvedAJEAqLh6DVS4NZMvz9oOgQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:22.047112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-d63f6485-fdb4-44d1-92aa-27305a340183 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:07:22.051144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-d63f6485-fdb4-44d1-92aa-27305a340183 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for user 0c4a4ce86beb47c2b7910264a9238c8b and project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:07:22.078121 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d63f6485-fdb4-44d1-92aa-27305a340183 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050672 Jun 20 11:07:22.078733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 131/254] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:07:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:23.046908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:23.047616 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:23.061826 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:23.062851 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:23.065433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:23.066567 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:23.322210 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:23.331237 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f2c32d43-75c8-4c5b-935d-ee44d6e74142 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1278 microversion: 2.1 time: 0.292392 Jun 20 11:07:23.332515 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 124/255] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:23 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:23.650488 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-6ea993b4-78d4-42c7-a860-5ff38800bf16 req-b48cf708-13d5-4e2a-8b9a-2a31b2588ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93072671-19ba-4bf7-bfb9-c5d98181cd98", "tag": "aed34f0b-54b2-4f4d-8270-55b349de05d7"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:23.676317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6ea993b4-78d4-42c7-a860-5ff38800bf16 req-b48cf708-13d5-4e2a-8b9a-2a31b2588ba6 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:23.683407 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6ea993b4-78d4-42c7-a860-5ff38800bf16 req-b48cf708-13d5-4e2a-8b9a-2a31b2588ba6 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:23.697986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-6ea993b4-78d4-42c7-a860-5ff38800bf16 req-b48cf708-13d5-4e2a-8b9a-2a31b2588ba6 service nova] Creating event network-changed:aed34f0b-54b2-4f4d-8270-55b349de05d7 for instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 on hv-cinder-84614 Jun 20 11:07:23.703728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-6ea993b4-78d4-42c7-a860-5ff38800bf16 req-b48cf708-13d5-4e2a-8b9a-2a31b2588ba6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060589 Jun 20 11:07:23.705013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 132/256] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:24.077037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1427992075", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04557a71-deaf-40bc-8f15-93648301a3a2"}], "security_groups": [{"name": "tempest-securitygroup--2099261978"}], "key_name": "tempest-keypair-531437473", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:24.244002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] validate_networks() for [('04557a71-deaf-40bc-8f15-93648301a3a2', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:07:24.349409 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:24.350808 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:24.359005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:24.359474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:24.360724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:24.361222 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:24.514941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:24.523092 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-79c8b861-9198-4f1c-ab4a-7ad14a691793 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1278 microversion: 2.1 time: 0.177931 Jun 20 11:07:24.534447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 133/257] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:24 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:07:25.144176 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:07:25.144684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:07:25.145111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:07:25.145487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:07:25.145895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:07:25.156744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:25.157192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:25.157985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:25.158448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:25.180567 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:07:25.184971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Getting quotas for user 0c4a4ce86beb47c2b7910264a9238c8b and project 4cab4c10ddc745418a470e5d50b77bea. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:07:25.197576 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:07:25.199746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:07:25.257467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b125bab7-bba6-4a20-a3b4-86ba3d416420 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.185754 Jun 20 11:07:25.258780 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 125/258] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:07:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:07:25.269154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9a9fe17-6bc3-4f4a-b2d0-5356c46bc0a6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:25.269745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f9a9fe17-6bc3-4f4a-b2d0-5356c46bc0a6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:25.371405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f9a9fe17-6bc3-4f4a-b2d0-5356c46bc0a6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:25.379465 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f9a9fe17-6bc3-4f4a-b2d0-5356c46bc0a6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1245 microversion: 2.1 time: 0.114345 Jun 20 11:07:25.382574 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 134/259] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:25 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1245 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:25.545644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:25.546267 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:25.553972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:25.555113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:25.556050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:25.556880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:25.734246 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:25.745014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3fb8a5b0-d01a-43ac-8b3a-d2f82c35c3fd tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1278 microversion: 2.1 time: 0.204281 Jun 20 11:07:25.745775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 126/260] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:25 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:26.398922 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:26.400094 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:26.408321 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:26.408793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:26.409637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:26.410066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:26.519685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:26.529944 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4abde1eb-b518-4d67-9364-9647967e634d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1249 microversion: 2.1 time: 0.135588 Jun 20 11:07:26.535017 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 135/261] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:26 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1249 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:26.761951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:26.762704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:26.770242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:26.770688 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:26.771440 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:26.772026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:26.774744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:26.948065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:26.956047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-64ec95d5-d8cd-4218-933b-f78d76b8640c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1278 microversion: 2.1 time: 0.197850 Jun 20 11:07:26.956841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 127/262] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:26 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:27.547820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:27.548540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:27.557834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:27.558409 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:27.559402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:27.559899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:27.674161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:27.682419 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e9958757-7926-4c9d-990a-c7013c20769b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1249 microversion: 2.1 time: 0.138912 Jun 20 11:07:27.683175 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 136/263] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:27 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1249 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:27.973251 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:27.973862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:27.982356 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:27.983100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:27.984387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:27.985319 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:28.280547 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:28.299792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-32fefc10-58b4-4222-991f-d93c2b3adece tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1278 microversion: 2.1 time: 0.330027 Jun 20 11:07:28.315870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 128/264] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:27 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:28.700905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:28.701362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:28.712718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:28.714868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:28.718363 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:28.719010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:28.730936 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:28.814548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:28.830256 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5bff9210-04f9-4065-8062-b11e9ffab704 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1249 microversion: 2.1 time: 0.133844 Jun 20 11:07:28.831106 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 137/265] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:28 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1249 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:29.320460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:29.321617 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:29.343989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:29.348051 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:29.351399 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:29.352022 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:29.849398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:29.849991 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:29.857211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:29.857856 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:29.858911 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:29.859834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:29.957888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:29.966550 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3df2abb9-d385-4139-b59f-a8c115666d63 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1241 microversion: 2.1 time: 0.120929 Jun 20 11:07:29.978186 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 138/266] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:29 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:07:30.063933 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:30.075297 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73ce2955-6ece-4051-a930-73a1d39bd1f1 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1278 microversion: 2.1 time: 0.761384 Jun 20 11:07:30.078116 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 129/267] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:29 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1278 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:30.989932 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:30.990650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:30.999438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:31.001335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:31.002354 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:31.003065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:31.081045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:31.093136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f453d2ce-af2c-4537-a158-4abdd084bd58 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1303 microversion: 2.1 time: 0.106654 Jun 20 11:07:31.095552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:31.096825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:31.104192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 139/268] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:30 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:31.114973 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:31.115533 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:31.117420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:31.117872 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:31.362907 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:31.371906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28fd4bed-85f5-41ff-aff6-203351b94e12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.281413 Jun 20 11:07:31.373172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 130/269] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:31 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:32.113138 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:32.114634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:32.123438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:32.124484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:32.125747 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:32.126638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:32.211646 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:32.238008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f79364db-814a-4d80-996c-2f1cb099ad96 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1303 microversion: 2.1 time: 0.118232 Jun 20 11:07:32.248510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 140/270] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:32 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:32.394300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:32.395095 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:32.398073 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:32.408577 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:32.409039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:32.409781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:32.410412 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:32.737527 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:32.747051 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8829f16b-1af8-448c-b719-8bfbd2001d43 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.357237 Jun 20 11:07:32.748388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 131/271] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:32 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:33.257244 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:33.257988 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:33.268555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:33.270364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:33.270897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:33.271912 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:33.272440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:33.377531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:33.389158 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-38c2da57-b573-4e02-a122-d7badeac2f9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1303 microversion: 2.1 time: 0.136999 Jun 20 11:07:33.390608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 141/272] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:33 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:33.765849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:33.766511 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:33.774116 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:33.774626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:33.775459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:33.775950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:33.925579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:33.933162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7768899c-74ac-4273-90e7-46f3eaa56644 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.172418 Jun 20 11:07:33.933805 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 132/273] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:33 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:34.415164 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:34.416702 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:34.424149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:34.424947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:34.426082 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:34.426884 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:34.574907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:34.582630 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e32e62fd-26e3-4fb3-8893-cc184fd4c67e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.179125 Jun 20 11:07:34.583426 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 142/274] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:34 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:34.953167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:34.954612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:34.964606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:34.965429 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:34.967999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:34.968851 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:35.170736 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:35.193152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:35.355994 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:35.366233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-653f5e9b-341b-4c51-8e36-0b383d488c9f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.419100 Jun 20 11:07:35.370158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 133/275] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:34 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:35.600821 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:35.601564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:35.607425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=8 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:35.610965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:35.611625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:35.612830 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:35.613335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:35.837404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:35.850703 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e1cc5f6c-850f-4f15-b126-fadb0abe60e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.253912 Jun 20 11:07:35.868968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 143/276] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:35 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:36.387750 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:36.388304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:36.395455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:36.396036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:36.396836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:36.397429 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:36.756294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:36.765075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ae1ed8c-f4c1-4455-8f5a-3e02296b5cb9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.381127 Jun 20 11:07:36.776085 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 134/277] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:36 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:36.868409 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:36.869362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:36.878259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:36.878704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:36.879686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:36.880126 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:37.059477 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:37.070179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-266da1ef-0f63-4ca0-abc5-2f729eb0a19d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.205416 Jun 20 11:07:37.071282 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 144/278] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:36 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:37.793029 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:37.801601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:37.808809 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:37.822705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:37.823892 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:37.824488 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:38.020307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-bbbd5bc8-8bf1-41e9-90ea-1229f7cb16b0 req-7b36d8c3-ea0e-4993-9651-9da4c3e334e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda5e0fc-11d3-4bd6-ab13-5403531f371f", "tag": "6ca3af82-3d2d-4c59-b7dc-43cea11de78e"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:38.035120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-bbbd5bc8-8bf1-41e9-90ea-1229f7cb16b0 req-7b36d8c3-ea0e-4993-9651-9da4c3e334e4 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:38.048828 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-bbbd5bc8-8bf1-41e9-90ea-1229f7cb16b0 req-7b36d8c3-ea0e-4993-9651-9da4c3e334e4 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:38.122990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-bbbd5bc8-8bf1-41e9-90ea-1229f7cb16b0 req-7b36d8c3-ea0e-4993-9651-9da4c3e334e4 service nova] Creating event network-changed:6ca3af82-3d2d-4c59-b7dc-43cea11de78e for instance fda5e0fc-11d3-4bd6-ab13-5403531f371f on hv-cinder-84614 Jun 20 11:07:38.148764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-bbbd5bc8-8bf1-41e9-90ea-1229f7cb16b0 req-7b36d8c3-ea0e-4993-9651-9da4c3e334e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128052 Jun 20 11:07:38.150951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 145/279] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:07:38.168605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:38.179957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a04e4b1-a211-4731-a9cf-bc5417ea512c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.401519 Jun 20 11:07:38.181208 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:38.182025 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:38.191146 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:38.195420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 135/280] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:37 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:38.196915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:38.202709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:38.203392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:38.438113 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:38.451355 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9a625d23-e10b-438d-8385-8fb9c72807ab tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.296769 Jun 20 11:07:38.453644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 146/281] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:38 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:39.200355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:39.201001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:39.209251 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:39.209251 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:39.210022 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:39.210749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:39.382746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:39.397154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96e8af9f-a865-49d0-9c51-90c75991447e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.200812 Jun 20 11:07:39.399044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 136/282] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:39 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:39.470898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:39.471620 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:39.480850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:39.481393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:39.482392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:39.483625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:39.722579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:39.751888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bbd53c9f-5c17-4065-bb75-3db8a431bcc5 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.285978 Jun 20 11:07:39.755102 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 147/283] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:39 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:40.417129 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:40.417834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:40.428234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:40.429246 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:40.430996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:40.431172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05eabd4d-2657-432a-a9d5-fe4a8f997e6d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Action: 'create', calling method: .version_select at 0x7f721649dee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-797202121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMd8sfufTKGCQhBlE3BmFOHNOXQezGiuMOIL7FU3tl3q7thVp31P7U2gYpYTogEQuE9uayWJlXMS4Y+t0UZ2Iq+7i6jm1T9THltFj6KAG7mCASItjpWJO/xdBtUCI3281Q=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:40.431929 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:40.471115 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-05eabd4d-2657-432a-a9d5-fe4a8f997e6d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Getting quotas for project 51c3f69c523b49e68d7d4d09f3236c4e. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:07:40.482806 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-05eabd4d-2657-432a-a9d5-fe4a8f997e6d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Getting quotas for user fdff9a743af948f88d60a6fd80795c06 and project 51c3f69c523b49e68d7d4d09f3236c4e. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:07:40.561895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05eabd4d-2657-432a-a9d5-fe4a8f997e6d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.384009 Jun 20 11:07:40.563294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 137/284] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:07:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:40.771913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:40.773570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:40.786918 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:40.787430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:40.788428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:40.788871 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:40.863697 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:40.871389 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-77692d4a-033c-465f-a5ce-7e573a99a68c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.459182 Jun 20 11:07:40.872156 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 148/285] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:40 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:41.000376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:41.008502 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-43af7e2b-a5c1-4a70-9a70-56ea6bc02222 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.241112 Jun 20 11:07:41.009518 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 138/286] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:40 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:41.891889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:41.891889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:41.901211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:41.902145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:41.903203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:41.903823 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:42.026376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:42.027644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:42.037217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:42.039647 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:42.041766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:42.043163 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:42.065665 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:42.078054 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4796acfe-1970-4c39-85c6-b92378f28e62 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.193041 Jun 20 11:07:42.082610 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 149/287] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:41 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:42.252853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:42.265501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c057c052-3835-40de-8947-ca027daccdaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.242961 Jun 20 11:07:42.266392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 139/288] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:42 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:43.097609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:43.099603 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:43.109966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:43.110712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:43.111755 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:43.112407 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:43.256815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:43.264636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-09cb5f2f-662f-44f0-83c9-e6072d8f6f2c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.173645 Jun 20 11:07:43.266119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 150/289] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:43 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:07:43.282963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:43.284160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:43.290661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:43.290827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:43.291549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:43.291979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:43.455154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:43.469285 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cfc06bef-0e20-4684-a2af-2fb71e5b22e1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.190159 Jun 20 11:07:43.490397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 140/290] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:43 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:44.281375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:44.281995 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:44.288962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:44.289420 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:44.290201 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:44.290652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:44.468163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:44.476045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c84dba5d-5328-465f-a550-94d884834530 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.198881 Jun 20 11:07:44.476619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 151/291] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:44 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:44.499195 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:44.499935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:44.507369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:44.507984 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:44.509057 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:44.510967 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:44.678357 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:44.686126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fa6b91b4-5a04-4e02-851b-cae4e84d6d04 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.191346 Jun 20 11:07:44.686587 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 141/292] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:44 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:45.494150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:45.495048 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:45.501188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:45.501639 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:45.502435 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:45.502873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:45.644865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:45.652826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ca816b98-36de-4199-b2f1-46671a665c12 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.162681 Jun 20 11:07:45.657288 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 152/293] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:45 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:45.703377 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:45.705398 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:45.711911 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:45.712384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:45.713172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:45.713813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:45.855630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:45.866986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66f1b69a-a989-44e0-aa82-13f4a3f8c94b tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.167775 Jun 20 11:07:45.867501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 142/294] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:45 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:46.669018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:46.669571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:46.676731 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:46.677182 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:46.677952 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:46.678416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:46.815578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:46.828002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a80ff102-3775-4c67-95c5-7c9e98bd209f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.162646 Jun 20 11:07:46.828747 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 153/295] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:46 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:46.887665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:46.888619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:46.895194 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:46.895643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:46.896402 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:46.896831 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:47.029250 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:47.037058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3b5532d-28fb-4c37-bc73-69c136b7313f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.155632 Jun 20 11:07:47.037643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 143/296] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:46 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:47.852947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:47.853561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:47.860728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:47.861179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:47.861951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:47.862428 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:47.877160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:47.998218 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:48.006283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-95acadb6-ddf8-41cc-a1dc-009001332d7c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.157269 Jun 20 11:07:48.007247 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 154/297] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:47 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:48.056858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:48.057463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:48.064255 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:48.064710 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:48.065466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:48.065901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:48.200553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:48.203361 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:48.212717 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63af7241-a815-401b-891b-4e7226bae1ea tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.159493 Jun 20 11:07:48.213491 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 144/298] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:48 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:49.023050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:49.023641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:49.030779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:49.031226 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:49.031999 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:49.032440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:49.175834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:49.183876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-df103aca-9a14-4c5c-8bcf-1b854ebdcdcb tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.164504 Jun 20 11:07:49.184497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 155/299] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:49 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:49.229246 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:49.229860 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:49.236943 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:49.237400 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:49.238378 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:49.238805 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:49.371650 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:49.379821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9d16f884-0398-4549-afa0-6ec593adaf45 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.154710 Jun 20 11:07:49.380400 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 145/300] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:49 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:50.202830 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:50.203425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:50.210444 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:50.210894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:50.211648 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:50.212112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:50.350906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:50.359397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-07b053fe-571c-42c5-a8a6-f8d3c5a1c328 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.161150 Jun 20 11:07:50.359962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 156/301] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:50 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:50.396859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:50.397570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:50.403671 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:50.404264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:50.405193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:50.405702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:50.498356 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:07:50.541093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:50.549235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-198ca428-c91d-4a73-bd24-e768c7ace882 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.156300 Jun 20 11:07:50.549807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 146/302] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:50 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:51.375588 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:51.376712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:51.383018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:51.383464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:51.384547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:51.384988 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:51.523840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:51.531728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4b4c1260-6140-472a-87a9-56fde4adbb13 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.160016 Jun 20 11:07:51.532298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 157/303] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:51 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:51.567937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:51.568774 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:51.575778 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:51.576457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:51.577227 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:51.577676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:51.718939 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:51.727322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5a9cf8b5-c59a-46b3-9db9-b1db47c64ad9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.163853 Jun 20 11:07:51.727973 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 147/304] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:51 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:51.744458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-21aae6df-c7ac-43d0-ab48-6c1236af44fe req-02667020-394b-4a88-bfe6-e8d93d0c840a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93072671-19ba-4bf7-bfb9-c5d98181cd98", "name": "network-vif-plugged", "status": "completed", "tag": "aed34f0b-54b2-4f4d-8270-55b349de05d7"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:51.754744 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-21aae6df-c7ac-43d0-ab48-6c1236af44fe req-02667020-394b-4a88-bfe6-e8d93d0c840a service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:51.755190 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-21aae6df-c7ac-43d0-ab48-6c1236af44fe req-02667020-394b-4a88-bfe6-e8d93d0c840a service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:51.766606 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-21aae6df-c7ac-43d0-ab48-6c1236af44fe req-02667020-394b-4a88-bfe6-e8d93d0c840a service nova] Creating event network-vif-plugged:aed34f0b-54b2-4f4d-8270-55b349de05d7 for instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 on hv-cinder-84614 Jun 20 11:07:51.772112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-21aae6df-c7ac-43d0-ab48-6c1236af44fe req-02667020-394b-4a88-bfe6-e8d93d0c840a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034285 Jun 20 11:07:51.772774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 158/305] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:52.549110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:52.549727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:52.556396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:52.557069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:52.557838 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:52.558311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:52.736820 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:52.746181 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:52.746639 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-25e0d2f5-7278-4290-9211-34a615724b96 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.201583 Jun 20 11:07:52.746900 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:52.754158 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:52.755004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:52.755971 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:52.756513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 148/306] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:52 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:52.756860 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:52.907493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:52.920900 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a1e459da-4429-4398-a33a-734a88503db1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.180619 Jun 20 11:07:52.921564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 159/307] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:52 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:07:53.763901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:53.765439 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:53.772741 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:53.773469 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:53.774615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:53.775190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:53.939678 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:53.941004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:53.954256 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:53.954722 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:53.955513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:53.955953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:53.966633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:53.980106 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ec852aa-3f95-437a-8fec-282800cd485b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.220272 Jun 20 11:07:53.980697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 149/308] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:53 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:54.176363 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:54.190780 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c4b30aff-12cf-4c1b-86c0-6b4e1c079e13 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.256269 Jun 20 11:07:54.192926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 160/309] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:53 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:54.996935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:54.997516 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:55.004651 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.005188 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.006065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.006603 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.148037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:55.156855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-862a1a9c-dc51-4a6b-b5d8-3125277e3417 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1266 microversion: 2.1 time: 0.163742 Jun 20 11:07:55.157395 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 150/310] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:54 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:55.209377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:55.210111 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:55.217077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.217594 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.218779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.219312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.297178 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:55.297746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:55.304133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.304943 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.306062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.306779 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.392498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:55.400663 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a6c22687-a0b0-4d59-9cae-7766084c83b0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.195227 Jun 20 11:07:55.401143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 161/311] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:55 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:55.459894 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lazy-loading 'services' on Instance uuid 554c0b82-5735-4eca-845d-0a777377b874 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:07:55.583492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a90d9716-a997-4acf-8a36-a6217518f732 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "DELETE /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874/os-volume_attachments/249286d3-3eca-4bad-86dc-ad6db4e82fb9" status: 202 len: 0 microversion: 2.1 time: 0.292482 Jun 20 11:07:55.584444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 151/312] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:07:55 2022] DELETE /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874/os-volume_attachments/249286d3-3eca-4bad-86dc-ad6db4e82fb9 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:07:55.848686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-61ffc245-6bf9-4634-977c-b487e67c5318 req-fb15ce79-0e29-4612-bceb-47c52afdc4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda5e0fc-11d3-4bd6-ab13-5403531f371f", "name": "network-vif-plugged", "status": "completed", "tag": "6ca3af82-3d2d-4c59-b7dc-43cea11de78e"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:55.858959 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-61ffc245-6bf9-4634-977c-b487e67c5318 req-fb15ce79-0e29-4612-bceb-47c52afdc4c1 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:55.859546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-61ffc245-6bf9-4634-977c-b487e67c5318 req-fb15ce79-0e29-4612-bceb-47c52afdc4c1 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:55.876180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-61ffc245-6bf9-4634-977c-b487e67c5318 req-fb15ce79-0e29-4612-bceb-47c52afdc4c1 service nova] Creating event network-vif-plugged:6ca3af82-3d2d-4c59-b7dc-43cea11de78e for instance fda5e0fc-11d3-4bd6-ab13-5403531f371f on hv-cinder-84614 Jun 20 11:07:55.883176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-61ffc245-6bf9-4634-977c-b487e67c5318 req-fb15ce79-0e29-4612-bceb-47c52afdc4c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040311 Jun 20 11:07:55.883975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 162/313] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:56.174829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:56.175692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:56.182416 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:56.182954 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:56.183732 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:56.184167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:56.324540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:56.332522 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-534c2f99-2a2a-454b-9171-10dcc113496a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1454 microversion: 2.1 time: 0.162317 Jun 20 11:07:56.332886 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 152/314] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:56 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:56.358503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:56.358503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:56.358503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:56.358503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:56.359250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:56.359777 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:56.416935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:56.417516 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:56.424108 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:56.424555 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:56.425385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:56.425997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:56.508022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:56.516379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8365e4e8-637a-4e11-835c-51b13b1661c9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1454 microversion: 2.1 time: 0.170404 Jun 20 11:07:56.519709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 163/315] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:56 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:56.586453 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:56.593916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b09f21f5-3793-4c4c-83db-3990132831c4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.180909 Jun 20 11:07:56.594520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 153/316] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:56 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:07:57.611549 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:57.612168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:57.619186 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:57.619673 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:57.620583 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:57.621062 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:57.761469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:57.766015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:57.766015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:57.769333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-21492202-2242-43aa-8398-cf294e9c0498 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.162193 Jun 20 11:07:57.770052 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 164/317] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:57 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:57.772812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:57.773282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:57.774045 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:57.774494 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:57.799257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:07:58.038356 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-29e6a748-9ce8-464a-a93b-031829d501a7 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "DELETE /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 204 len: 0 microversion: 2.1 time: 0.276778 Jun 20 11:07:58.038934 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 154/318] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:07:57 2022] DELETE /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:07:58.047184 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:58.048036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:58.064546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:58.066319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:58.068608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:58.069120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:58.201949 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:58.210854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7c5caa66-56ac-453d-9cf9-4dca02a16cfb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1559 microversion: 2.1 time: 0.167612 Jun 20 11:07:58.211429 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 165/319] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:58 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:58.401805 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-961e7472-1940-4d47-85b5-2f3d47856c17 req-695abd73-5803-4727-adf4-71b2f7c55966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93072671-19ba-4bf7-bfb9-c5d98181cd98", "tag": "aed34f0b-54b2-4f4d-8270-55b349de05d7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:07:58.411626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-961e7472-1940-4d47-85b5-2f3d47856c17 req-695abd73-5803-4727-adf4-71b2f7c55966 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:58.412521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-961e7472-1940-4d47-85b5-2f3d47856c17 req-695abd73-5803-4727-adf4-71b2f7c55966 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:58.427232 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-961e7472-1940-4d47-85b5-2f3d47856c17 req-695abd73-5803-4727-adf4-71b2f7c55966 service nova] Creating event network-changed:aed34f0b-54b2-4f4d-8270-55b349de05d7 for instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 on hv-cinder-84614 Jun 20 11:07:58.432268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-961e7472-1940-4d47-85b5-2f3d47856c17 req-695abd73-5803-4727-adf4-71b2f7c55966 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034832 Jun 20 11:07:58.434871 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 155/320] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:07:58.786558 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:58.787260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:58.794297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:58.794751 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:58.795497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:58.795954 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:58.936394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:58.945510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-855679aa-f000-4dce-8797-592a0da8c31f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.162779 Jun 20 11:07:58.946117 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 166/321] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:58 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:59.230122 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:59.230853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:59.237320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:59.237771 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:59.238569 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:59.239048 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:59.375046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:07:59.383570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6b878028-1083-46e0-b437-4961aa25eada tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1559 microversion: 2.1 time: 0.158349 Jun 20 11:07:59.384179 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 156/322] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:59 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:07:59.965330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:07:59.965851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:07:59.974113 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:59.974566 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:07:59.975334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:07:59.975773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:00.118742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:00.130065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2445c85f-6f9a-4305-8a83-cb7621246d60 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.170621 Jun 20 11:08:00.130654 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 167/323] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:07:59 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:00.405086 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:00.406079 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:00.416558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:00.417305 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:00.418612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:00.419342 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:00.560111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:00.569232 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-30f5d7f2-4a6b-414d-8a42-d21886123d81 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1559 microversion: 2.1 time: 0.170764 Jun 20 11:08:00.569901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 157/324] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:00 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:01.153163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:01.154275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:01.167345 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:01.167962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:01.169223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:01.169942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:01.310770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:01.319138 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-063a30c7-d2a9-4a48-bd00-dbd1b637a768 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.173879 Jun 20 11:08:01.319712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 168/325] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:01 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:01.588611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:01.589302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:01.595993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:01.596441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:01.597214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:01.597631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:01.732878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:01.741547 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77d7eb93-8362-431f-b584-5cf6ac00d288 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1559 microversion: 2.1 time: 0.156905 Jun 20 11:08:01.742254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 158/326] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:01 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:02.340473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:02.341397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:02.350380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:02.350832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:02.351584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:02.352011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:02.504764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:02.512568 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2e1cb1fc-1872-4fc7-9b33-50f5f40eba39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.178572 Jun 20 11:08:02.513140 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 169/327] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:02 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:02.584704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:08:02.584955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:08:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:08:02.759685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:02.760479 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:02.762392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:02.769157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:02.769698 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:02.770515 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:02.770955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:02.921670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:02.923938 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:02.931550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14d780a4-7c4a-43a1-9ce2-c351507376ca tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1559 microversion: 2.1 time: 0.176064 Jun 20 11:08:02.932120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 159/328] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:02 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:03.529076 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:03.529652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:03.532256 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=58 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:03.539318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:03.539757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:03.540524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:03.541045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:03.681555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:03.689169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-015c9695-1c02-4051-94ed-61ba97b22451 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.164060 Jun 20 11:08:03.689969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 170/329] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:03 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:03.951303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:03.951917 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:03.959508 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:03.959954 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:03.960712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:03.961143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:04.098149 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:04.109847 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45493034-bd08-4e0b-bdb9-9e5656cdec2d tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1559 microversion: 2.1 time: 0.162579 Jun 20 11:08:04.110489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 160/330] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:03 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:04.707521 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:04.708116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:04.715163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:04.715616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:04.716374 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:04.716804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:04.866880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:04.874374 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2007d8dc-b0f0-4e5d-a574-a2addeec1c9d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.171318 Jun 20 11:08:04.874936 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 171/331] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:04 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:05.129935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:05.130586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:05.137157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:05.137601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:05.138362 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:05.138797 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:05.281206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:05.291214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13b112d2-5ee8-40d3-a9b4-67039f5e9fe8 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.166573 Jun 20 11:08:05.300835 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 161/332] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:05 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:05.896400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:05.897412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:05.908776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:05.909660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:05.910714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:05.911170 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:05.926682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:06.056771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:06.064759 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-333bccfa-3d31-4731-8556-d3fc92ce1f99 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1371 microversion: 2.1 time: 0.175488 Jun 20 11:08:06.065328 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 172/333] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:05 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:06.312571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:06.313413 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:06.324309 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:06.325044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:06.326343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:06.327071 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:06.464612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:06.472773 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-56cf0bbe-ef51-4caa-b9c5-9424c7894eab tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.166477 Jun 20 11:08:06.473580 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 162/334] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:06 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:07.084738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:07.085335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:07.092097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:07.092546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:07.093305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:07.093740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:07.234366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:07.242428 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-df95f247-277f-4137-a5fc-585c4d930679 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1564 microversion: 2.1 time: 0.162373 Jun 20 11:08:07.242978 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 173/335] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:07 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:07.258816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:07.259313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:07.265609 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:07.266054 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:07.266848 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:07.267286 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:07.358878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ed39afb3-5554-4736-9a05-0f8a2cc37ac4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103483 Jun 20 11:08:07.359776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 163/336] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:08:07 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:08:07.489826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:07.490572 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:07.497036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:07.497570 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:07.498407 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:07.498921 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:07.634045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:07.642319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-43c68225-da50-449b-acc8-fd9597e57ed3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.156333 Jun 20 11:08:07.643054 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 174/337] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:07 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:08.553044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-5e175a65-e89e-42c4-97ce-c8e563bf05aa req-382d77e1-d412-4772-a1bf-f792cf509114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda5e0fc-11d3-4bd6-ab13-5403531f371f", "tag": "6ca3af82-3d2d-4c59-b7dc-43cea11de78e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:08.562473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5e175a65-e89e-42c4-97ce-c8e563bf05aa req-382d77e1-d412-4772-a1bf-f792cf509114 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:08.562985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5e175a65-e89e-42c4-97ce-c8e563bf05aa req-382d77e1-d412-4772-a1bf-f792cf509114 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:08.575542 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-5e175a65-e89e-42c4-97ce-c8e563bf05aa req-382d77e1-d412-4772-a1bf-f792cf509114 service nova] Creating event network-changed:6ca3af82-3d2d-4c59-b7dc-43cea11de78e for instance fda5e0fc-11d3-4bd6-ab13-5403531f371f on hv-cinder-84614 Jun 20 11:08:08.580957 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-5e175a65-e89e-42c4-97ce-c8e563bf05aa req-382d77e1-d412-4772-a1bf-f792cf509114 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032206 Jun 20 11:08:08.581895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 164/338] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:08.660468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:08.661035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:08.667809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:08.668259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:08.669028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:08.669457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:08.803425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:08.811263 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-56059c43-1097-41e0-b017-8dfeaf6c7903 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.154906 Jun 20 11:08:08.811836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 175/339] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:08 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:09.830410 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:09.831130 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:09.838554 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:09.838997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:09.839750 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:09.840179 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:09.975634 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:09.983626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f67c0c1b-41ba-4736-b111-8a42844fd51b tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.157591 Jun 20 11:08:09.984175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 165/340] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:09 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:11.005222 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:11.006260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:11.017387 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:11.018148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:11.019380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:11.019835 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:11.153585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:11.161634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-74aa3c3e-e5c7-43fe-8a26-dc61f94531c4 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.163088 Jun 20 11:08:11.162229 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 176/341] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:10 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:12.179861 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:12.180450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:12.187030 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:12.187474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:12.188243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:12.188674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:12.334125 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:12.342039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2d644427-4c18-44a0-ad0d-dfc30f7113bb tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.166777 Jun 20 11:08:12.342655 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 166/342] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:12 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:13.361012 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:13.361873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:13.371942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:13.372449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:13.373495 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:13.374111 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:13.502874 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:13.512350 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-72ba5768-f78d-4e4f-af10-7bfec7ba924f tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.156670 Jun 20 11:08:13.512975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 177/343] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:13 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:14.529006 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:14.529675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:14.536167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:14.536644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:14.537417 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:14.537850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:14.806198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:14.816509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c13b642-e9d6-47ac-8e17-108bdd9a1094 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1513 microversion: 2.1 time: 0.290935 Jun 20 11:08:14.820430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 167/344] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:14 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:15.307633 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-80aeb548-df2f-4e05-abf9-83244b2cc236 req-57079437-33eb-4ebb-b1cb-4a974a09e2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554c0b82-5735-4eca-845d-0a777377b874", "name": "network-vif-deleted", "tag": "90516466-9482-47d6-acdc-f524997026f2"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:15.321018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-80aeb548-df2f-4e05-abf9-83244b2cc236 req-57079437-33eb-4ebb-b1cb-4a974a09e2d1 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:15.322822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-80aeb548-df2f-4e05-abf9-83244b2cc236 req-57079437-33eb-4ebb-b1cb-4a974a09e2d1 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:15.344360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-80aeb548-df2f-4e05-abf9-83244b2cc236 req-57079437-33eb-4ebb-b1cb-4a974a09e2d1 service nova] Creating event network-vif-deleted:90516466-9482-47d6-acdc-f524997026f2 for instance 554c0b82-5735-4eca-845d-0a777377b874 on hv-cinder-84614 Jun 20 11:08:15.350383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-80aeb548-df2f-4e05-abf9-83244b2cc236 req-57079437-33eb-4ebb-b1cb-4a974a09e2d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046579 Jun 20 11:08:15.351112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 178/345] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:08:15.841669 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:15.842276 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:15.848821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:15.849563 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:15.850109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:15.850569 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:15.924528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:15.933190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d4b17e78-7c49-417c-93f0-f1f1e3c4ee46 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1304 microversion: 2.1 time: 0.098879 Jun 20 11:08:15.933811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 168/346] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:15 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:16.954048 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:16.954858 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:16.964854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:16.965337 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:16.966120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:16.966577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:17.037584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:17.045740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-327c4f2d-1671-4104-b283-41be50da5f48 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1304 microversion: 2.1 time: 0.098166 Jun 20 11:08:17.046327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 179/347] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:16 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:18.063177 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:18.063770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:18.071528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:18.071983 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:18.072754 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:18.073185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:18.140345 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:18.148419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e84024e-9d65-4a82-9609-20cca4812a92 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1304 microversion: 2.1 time: 0.089315 Jun 20 11:08:18.149012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 169/348] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:18 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:19.170890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:19.171541 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:19.182205 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:19.182919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:19.184287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:19.184992 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:19.282843 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:19.293269 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a6dc9895-baea-4f34-85a6-21795b6616c0 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1304 microversion: 2.1 time: 0.126731 Jun 20 11:08:19.294297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 180/349] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:19 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:20.313631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:20.314242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:20.321225 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:20.321675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:20.322444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:20.322907 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:20.355621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:20.356070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:20.356509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lazy-loading 'fault' on Instance uuid 554c0b82-5735-4eca-845d-0a777377b874 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:08:20.419310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:20.419310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-be715cfc-c504-46c0-8d47-76cd2dbfb463 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 200 len: 1309 microversion: 2.1 time: 0.106088 Jun 20 11:08:20.419310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 170/350] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:20 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:21.436165 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:21.436733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: 554c0b82-5735-4eca-845d-0a777377b874] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:21.444213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:21.444658 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:21.445482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:21.445911 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:21.459393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] HTTP exception thrown: Instance 554c0b82-5735-4eca-845d-0a777377b874 could not be found. Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Request method failure captured: Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 HTTP/1.1 Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFSEWGUrOyNrIp7H5v2aPGdzBWscJhkWeHmI3sQuVnPY8_AoHBxhOVZQinAdCO8prfVkQlu9sXQOITGWn_irwGvk0KyLc2NJ5OubYn5GA5PBtZvDzsM4t1GlgFKU7b5EwDVQyicNt9UH-AXBv7Mc5DD3tNsJ172XRS3iA5hrb8kzuUI Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: d47c143cf33a41799202d5f7d90a66b5 Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2065443662 Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:08:21.461195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesSnapshotTestJSON-2065443662 Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: d47c143cf33a41799202d5f7d90a66b5 Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2065443662 Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesSnapshotTestJSON-2065443662-project Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: a96fa98fa00c4de29a9bed22ed9e597b Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesSnapshotTestJSON-2065443662-project Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 554c0b82-5735-4eca-845d-0a777377b874 could not be found. Jun 20 11:08:21.463926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '554c0b82-5735-4eca-845d-0a777377b874'} Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554c0b82-5735-4eca-845d-0a777377b874 could not be found. Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:08:21.465532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554c0b82-5735-4eca-845d-0a777377b874 could not be found. Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554c0b82-5735-4eca-845d-0a777377b874 could not be found. Jun 20 11:08:21.468197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:08:21.470804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Returning 404 to user: Instance 554c0b82-5735-4eca-845d-0a777377b874 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:08:21.470804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3a2b5ed7-4e67-440e-8137-e3e460361159 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874" status: 404 len: 111 microversion: 2.1 time: 0.030410 Jun 20 11:08:21.470804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 181/351] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:21 2022] GET /compute/v2.1/servers/554c0b82-5735-4eca-845d-0a777377b874 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:08:35.500015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2018982870", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "networks": [{"uuid": "dbe44c05-2646-4c0b-9ae2-77381095b334"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:35.507029 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=25 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:35.507676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=63 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:35.555870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] validate_networks() for [('dbe44c05-2646-4c0b-9ae2-77381095b334', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:08:35.915347 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:08:35.915804 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:08:35.916303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:08:35.916705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:08:35.917105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:08:35.926328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:35.926782 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:35.927563 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:35.927990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:35.946401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Getting quotas for project d47c143cf33a41799202d5f7d90a66b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:08:35.950548 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Getting quotas for user a96fa98fa00c4de29a9bed22ed9e597b and project d47c143cf33a41799202d5f7d90a66b5. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:08:35.963296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:08:35.965564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:08:36.012263 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f78d8d07-77e9-4815-b344-3e01892bb417 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516100 Jun 20 11:08:36.012921 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 171/352] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:08:36.023154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b2bba14b-79cb-4bb6-a4bf-b000d18f950e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:36.023832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b2bba14b-79cb-4bb6-a4bf-b000d18f950e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:36.026667 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=23 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:36.027325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=49 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:36.082120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b2bba14b-79cb-4bb6-a4bf-b000d18f950e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:36.089224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b2bba14b-79cb-4bb6-a4bf-b000d18f950e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1219 microversion: 2.1 time: 0.070006 Jun 20 11:08:36.089975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 182/353] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:36 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:36.420277 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-32487033", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-797202121", "security_groups": [{"name": "tempest-secgroup-smoke-1880076591"}], "networks": [{"uuid": "e7059e1b-88be-4287-b848-e9f7162b9af4"}], "block_device_mapping_v2": [{"uuid": "08aa8112-e8a6-4c85-a602-71ee6031cafa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:36.546461 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] validate_networks() for [('e7059e1b-88be-4287-b848-e9f7162b9af4', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:08:37.106957 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:37.107601 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:37.114972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:37.115652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:37.116642 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:37.117409 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:37.187238 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:37.195136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e92ac8d1-11ba-4529-83b4-b20ed74e6b4c tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1289 microversion: 2.1 time: 0.092634 Jun 20 11:08:37.195749 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 183/354] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:37 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:08:37.365913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:08:37.366434 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:08:37.366897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:08:37.367447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:08:37.368088 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:08:37.380557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:37.381230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:37.382728 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:37.383523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:37.401459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Getting quotas for project 51c3f69c523b49e68d7d4d09f3236c4e. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:08:37.405608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Getting quotas for user fdff9a743af948f88d60a6fd80795c06 and project 51c3f69c523b49e68d7d4d09f3236c4e. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:08:37.470489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:08:37.472520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08aa8112-e8a6-4c85-a602-71ee6031cafa',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:08:37.608257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d220a1d6-c2b7-48e3-9f16-030d3cdbddd4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.191804 Jun 20 11:08:37.619402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6bf8bc11-9986-4b9a-9633-b78a820064f1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:37.620044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6bf8bc11-9986-4b9a-9633-b78a820064f1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:37.623109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 172/355] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:08:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:08:37.696102 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6bf8bc11-9986-4b9a-9633-b78a820064f1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:37.714540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6bf8bc11-9986-4b9a-9633-b78a820064f1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1086 microversion: 2.1 time: 0.099422 Jun 20 11:08:37.715162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 184/356] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:37 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1086 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:08:38.215417 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:38.216418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:38.226993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:38.227928 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:38.228819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:38.229372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:38.527470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:38.535269 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-681a9e23-fd85-4cb8-afe9-a21952d486a9 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.326411 Jun 20 11:08:38.535963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 173/357] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:38 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:38.737693 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:38.739296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:38.752230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:38.752968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:38.753820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:38.754550 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:38.841365 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:38.858853 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7c155b80-e45a-4b28-bc76-c42dd53fa8e5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1192 microversion: 2.1 time: 0.129028 Jun 20 11:08:38.859607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 185/358] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:38 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:38.934329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f73cee4a-f311-4273-a37a-4f49c83314e7 req-fadb2c1d-7859-4809-a605-dc95d457540d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13ba185-72e3-4e27-9041-9fb4f2377e5d", "tag": "e5351d90-87f7-483a-bef4-d9884b0a07b3"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:38.949125 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f73cee4a-f311-4273-a37a-4f49c83314e7 req-fadb2c1d-7859-4809-a605-dc95d457540d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:38.950174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f73cee4a-f311-4273-a37a-4f49c83314e7 req-fadb2c1d-7859-4809-a605-dc95d457540d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:38.966493 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f73cee4a-f311-4273-a37a-4f49c83314e7 req-fadb2c1d-7859-4809-a605-dc95d457540d service nova] Creating event network-changed:e5351d90-87f7-483a-bef4-d9884b0a07b3 for instance d13ba185-72e3-4e27-9041-9fb4f2377e5d on hv-cinder-84614 Jun 20 11:08:38.974943 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f73cee4a-f311-4273-a37a-4f49c83314e7 req-fadb2c1d-7859-4809-a605-dc95d457540d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046831 Jun 20 11:08:38.975785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 174/359] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:39.552592 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:39.553408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:39.560651 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:39.561160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:39.562029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:39.562600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:39.718497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:39.727419 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b24d43d5-d10d-4197-996f-b05879df1b36 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.178465 Jun 20 11:08:39.728000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 186/360] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:39 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:39.880684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:39.881978 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:39.925232 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:39.926224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:39.927503 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:39.928221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:40.156333 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:40.166012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-20684a9c-5fda-42df-86a9-2be4e75ce442 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.292085 Jun 20 11:08:40.166849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 175/361] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:39 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:40.747333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:40.747975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:40.754848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:40.755293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:40.756050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:40.756560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:40.899340 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:40.907432 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ff73f62a-b59d-4f4c-bb77-4a7656771c53 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.164203 Jun 20 11:08:40.908021 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 187/362] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:40 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:41.185404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:41.186209 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:41.193531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:41.193978 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:41.194769 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:41.195199 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:41.342610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:41.350296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-547f1b27-6135-405a-81a6-0befcbb38551 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.168897 Jun 20 11:08:41.350851 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 176/363] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:41 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:41.924530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:41.925138 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:41.932202 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:41.932632 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:41.933422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:41.933853 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:42.069879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:42.078361 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9a4310fe-79f9-4988-bcc7-6b15085687d2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.157681 Jun 20 11:08:42.078899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 188/364] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:41 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:42.367428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:42.368021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:42.375081 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:42.375578 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:42.376332 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:42.377293 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:42.522598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:42.533877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5b4481d-2d3d-4e20-9ac6-39c1337f500c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.169951 Jun 20 11:08:42.534875 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 177/365] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:42 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:43.098615 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:43.099183 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:43.108938 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:43.109504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:43.110694 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:43.111300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:43.260308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:43.268986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dbdb1e68-9f5f-4ffe-9bf0-fcdcf5efd313 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.176166 Jun 20 11:08:43.269575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 189/366] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:43 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:43.555654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:43.556442 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:43.563440 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:43.563885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:43.564645 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:43.565047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:43.707317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:43.717843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-389e183e-2ca2-42c8-aff4-da7b5aeb45ab tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.167397 Jun 20 11:08:43.718456 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 178/367] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:43 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:44.290238 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:44.290997 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:44.300940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:44.301394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:44.302474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:44.303140 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:44.447848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:44.456016 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aebe1289-e6a8-498e-a70d-317fd85c8374 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.172218 Jun 20 11:08:44.456538 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 190/368] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:44 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:44.742815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:44.743644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:44.755114 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:44.755858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:44.757154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:44.757876 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:44.904696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:44.913497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bed825a3-60dd-4a00-8b11-13266cc73054 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.177326 Jun 20 11:08:44.915788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 179/369] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:44 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:45.473341 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:45.473952 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:45.480554 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:45.480999 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:45.481753 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:45.482295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:45.617416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:45.627059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6e44ba16-ff6b-4d57-9f76-7bb9c86036c6 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.157526 Jun 20 11:08:45.628033 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 191/370] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:45 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:45.932827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:45.933397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:45.940749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:45.941558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:45.942416 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:45.942846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:46.077868 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:46.085916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c29e40f8-4256-4707-a12b-dc9e4ed26a31 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.156981 Jun 20 11:08:46.086521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 180/371] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:45 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:08:46.597616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:46.598513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:46.605270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:46.605715 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:46.606501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:46.606932 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:46.644025 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:46.644638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:46.651394 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:46.651825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:46.652602 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:46.653026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:46.795837 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:46.804310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1488c325-334f-40bf-a242-c13a34a41096 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.164250 Jun 20 11:08:46.804883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 181/372] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:46 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:47.104171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:47.104946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:47.111821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:47.112326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:47.113332 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:47.113727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:47.254531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:47.262993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6e11e2f-4f84-41b2-8fe9-0d64640de770 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.162905 Jun 20 11:08:47.263537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 182/373] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:47 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:08:47.702691 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:47.822616 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:47.823264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:47.825239 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:47.825888 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=12 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:47.832291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:47.832738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:47.833548 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:47.833994 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:47.978630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:47.988096 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ccaaebb1-17de-4c49-82e8-8557fd2d24cd tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.169792 Jun 20 11:08:47.988704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 183/374] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:47 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:48.043637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-64657563-2ea0-4e6f-9487-39670beb3a87 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action" status: 200 len: 36746 microversion: 2.1 time: 1.451871 Jun 20 11:08:48.046718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 192/375] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:08:46 2022] POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action => generated 36746 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:08:48.284976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:48.285581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:48.294175 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:48.294753 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:48.301751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:48.303021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:48.303981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:48.304116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:48.304414 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:48.304518 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:48.305177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:48.305644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:48.332357 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-075a8e6a-feec-43f1-82f4-3c905d022caf tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/ips" status: 200 len: 146 microversion: 2.1 time: 0.042275 Jun 20 11:08:48.333120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 193/376] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:08:48 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:48.650268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:48.658223 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad62074b-61ed-4450-9f19-c8ac86075d8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.377115 Jun 20 11:08:48.667965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 184/377] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:48 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:49.006434 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:49.007753 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:49.014974 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:49.015698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:49.016704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:49.017581 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:49.146970 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f033f005-0e8c-4aee-a86d-67c444c4937d req-d319a62e-add2-44b5-9d11-8bb0e1a9ff6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:49.157849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f033f005-0e8c-4aee-a86d-67c444c4937d req-d319a62e-add2-44b5-9d11-8bb0e1a9ff6b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:49.158551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f033f005-0e8c-4aee-a86d-67c444c4937d req-d319a62e-add2-44b5-9d11-8bb0e1a9ff6b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:49.171326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f033f005-0e8c-4aee-a86d-67c444c4937d req-d319a62e-add2-44b5-9d11-8bb0e1a9ff6b service nova] Creating event network-changed:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:08:49.189531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f033f005-0e8c-4aee-a86d-67c444c4937d req-d319a62e-add2-44b5-9d11-8bb0e1a9ff6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046699 Jun 20 11:08:49.190307 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 185/378] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:49.199661 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:49.211216 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-14c7734b-0fe1-461d-9c46-c9b03d166ae5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.208952 Jun 20 11:08:49.221028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 194/379] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:49 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:49.677809 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:49.679192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:49.687736 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:49.687985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:49.689153 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:49.689705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:49.906873 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:49.917142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09ceadba-6073-4a7e-9653-f221f8587e5b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.243724 Jun 20 11:08:49.926270 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 186/380] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:49 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:50.229278 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:50.229825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:50.236761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:50.237180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:50.237976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:50.238457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:50.375144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:50.382965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0278d077-ec58-4e62-92f4-f00fefd338a3 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.157892 Jun 20 11:08:50.383530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 195/381] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:50 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:50.590565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-52e2ea33-1999-4225-a7f0-be6686321ec6 req-e6d766c9-7dc8-40cc-9e87-c6aab861e716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13ba185-72e3-4e27-9041-9fb4f2377e5d", "name": "network-vif-plugged", "status": "completed", "tag": "e5351d90-87f7-483a-bef4-d9884b0a07b3"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:50.599532 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-52e2ea33-1999-4225-a7f0-be6686321ec6 req-e6d766c9-7dc8-40cc-9e87-c6aab861e716 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:50.599946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-52e2ea33-1999-4225-a7f0-be6686321ec6 req-e6d766c9-7dc8-40cc-9e87-c6aab861e716 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:50.612733 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-52e2ea33-1999-4225-a7f0-be6686321ec6 req-e6d766c9-7dc8-40cc-9e87-c6aab861e716 service nova] Creating event network-vif-plugged:e5351d90-87f7-483a-bef4-d9884b0a07b3 for instance d13ba185-72e3-4e27-9041-9fb4f2377e5d on hv-cinder-84614 Jun 20 11:08:50.617684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-52e2ea33-1999-4225-a7f0-be6686321ec6 req-e6d766c9-7dc8-40cc-9e87-c6aab861e716 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030894 Jun 20 11:08:50.618651 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 187/382] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:50.934154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:50.935148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:50.943107 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:50.943437 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:50.944543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:50.945349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:51.087785 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:51.095551 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8a5ede4e-6e11-4ee2-bb63-b506fb596104 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.165459 Jun 20 11:08:51.096115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 196/383] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:50 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:51.401167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:51.402024 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:51.408507 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:51.409058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:51.409929 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:51.410386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:51.696312 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:51.704197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-77851397-3ec0-4799-af56-5b126af2ae27 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.308546 Jun 20 11:08:51.704798 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 188/384] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:51 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:52.053142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad6e797f-83ed-4616-b9e9-421d874d732a"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:52.054288 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:52.060904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:52.061352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:52.062130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:52.062566 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:52.112543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:52.113292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:52.119700 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:52.120224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:52.121192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:52.121640 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:52.372257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:52.384167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc52f40c-55da-4998-bc24-0867c8030145 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.275306 Jun 20 11:08:52.384913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 189/385] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:52 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:52.393643 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-53246da0-b978-41d7-8e3f-6818cb59d1c0 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344323 Jun 20 11:08:52.394827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 197/386] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:08:52 2022] POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:52.726807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:52.727492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:52.734836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:52.735588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:52.736467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:52.736904 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:52.890800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:52.894628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:52.900580 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1abf9cf7-a389-4022-bee3-0b3809c0d839 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.178674 Jun 20 11:08:52.901181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 190/387] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:52 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:53.402591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:53.403245 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:53.410629 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:53.411070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:53.411826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:53.412255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:53.561075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:53.569449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-34c33f9f-4e5a-4dc2-aca4-018e853f850e tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.171289 Jun 20 11:08:53.570350 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 198/388] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:53 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:53.921035 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:53.921616 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:53.928663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:53.928869 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:53.929539 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:53.929972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:54.080157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:54.088105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-633017ee-895e-42dc-910c-9cff53cc17ba tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1319 microversion: 2.1 time: 0.171282 Jun 20 11:08:54.088679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 191/389] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:53 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:54.589674 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:54.590329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:54.600207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:54.600771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:54.601699 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:54.602303 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:54.742617 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:54.746364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:08:54.751280 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-60b85bef-bc44-4c54-a15c-8497f84b87f9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.167748 Jun 20 11:08:54.751852 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 199/390] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:54 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:55.109595 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:55.110264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:55.118817 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:55.120459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:55.125692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:55.126185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:55.276370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:55.286562 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f3f4ebdc-99f1-4e39-8525-2a72f3fbc90e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1507 microversion: 2.1 time: 0.180217 Jun 20 11:08:55.287457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 192/391] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:55 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:55.304004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd3e671c-0255-4483-883f-9bbdf86c14d2", "device": "/dev/sdb"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:08:55.305166 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:55.316321 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:55.316873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:55.317869 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:55.318414 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:55.611737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bc59e8d0-bb10-4149-a426-5bf668521da2 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "POST /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311366 Jun 20 11:08:55.612688 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 200/392] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:08:55 2022] POST /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:08:55.768535 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:55.769181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:55.778853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:55.779304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:55.780162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:55.780596 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:55.960256 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:55.969906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe729da2-14a9-4ef0-aa95-1601eedb7b38 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.205172 Jun 20 11:08:55.970548 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 193/393] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:55 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:56.990393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:56.991069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:56.998013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:56.998486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:56.999264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:56.999692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:57.155940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:57.164986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-03a2bb8e-defa-4920-bced-029af4266ccd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.179248 Jun 20 11:08:57.165590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 201/394] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:56 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:58.184772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:58.185444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:58.194487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:58.195303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:58.196411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:58.197146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:58.357136 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:58.365543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-63d927d1-c620-4402-bdb9-4c5447a109d3 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.186800 Jun 20 11:08:58.366142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 194/395] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:58 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:08:59.382852 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:08:59.383671 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:08:59.391183 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:59.391604 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:59.392452 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:08:59.392907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:08:59.531690 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:08:59.539736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0f98ebb6-d35b-47b9-8c59-9ade09adc946 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.160924 Jun 20 11:08:59.540306 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 202/396] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:08:59 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:00.556961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:00.557648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:00.564400 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:00.564900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:00.565750 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:00.566581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:00.707974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:00.716260 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e644bfba-6bc4-4303-b6c7-6c50804fb392 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.163363 Jun 20 11:09:00.716842 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 195/397] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:00 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:00.930685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-d5b4d368-88e2-4bb1-9d9d-61a4b3f44324 req-344a2350-3db6-4517-955c-1b66597da880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "name": "network-vif-plugged", "status": "completed", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:09:00.942609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d5b4d368-88e2-4bb1-9d9d-61a4b3f44324 req-344a2350-3db6-4517-955c-1b66597da880 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:00.943477 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d5b4d368-88e2-4bb1-9d9d-61a4b3f44324 req-344a2350-3db6-4517-955c-1b66597da880 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:00.958732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-d5b4d368-88e2-4bb1-9d9d-61a4b3f44324 req-344a2350-3db6-4517-955c-1b66597da880 service nova] Creating event network-vif-plugged:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:09:00.963923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-d5b4d368-88e2-4bb1-9d9d-61a4b3f44324 req-344a2350-3db6-4517-955c-1b66597da880 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038061 Jun 20 11:09:00.964627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 203/398] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:09:01.073919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-416b0ff1-81e9-4d9c-b218-7c870cc29ac8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:09:01.080670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-416b0ff1-81e9-4d9c-b218-7c870cc29ac8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:01.081111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-416b0ff1-81e9-4d9c-b218-7c870cc29ac8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:01.146606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-416b0ff1-81e9-4d9c-b218-7c870cc29ac8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Going to try to stop instance {{(pid=117606) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 11:09:01.199910 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-416b0ff1-81e9-4d9c-b218-7c870cc29ac8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action" status: 202 len: 0 microversion: 2.1 time: 0.129212 Jun 20 11:09:01.201435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 196/399] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:09:01 2022] POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:09:01.210198 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:01.210427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:01.217379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:01.218279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:01.218642 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:01.219053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:01.361417 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:01.369983 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8f04d179-c4f7-4646-88f4-2373640c1c0c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.164672 Jun 20 11:09:01.370978 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 204/400] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:01 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:01.734253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:01.734865 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:01.741638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:01.742111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:01.742920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:01.743353 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:01.896699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:01.905139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c683595f-f85a-4b4e-a9ec-02848d03343d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.175281 Jun 20 11:09:01.905727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 197/401] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:01 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:02.396709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:02.397710 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:02.406488 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:02.406912 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:02.408047 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:02.408980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:02.554017 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:02.562888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3e5b0890-97a6-46d4-a30b-8b029d627e24 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.172110 Jun 20 11:09:02.563476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 205/402] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:02 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:02.922653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:02.923254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:02.929738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:02.930190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:02.931093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:02.931522 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:03.075856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:03.084314 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-118c67bd-9065-4b79-af45-52639f71029a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1258 microversion: 2.1 time: 0.165788 Jun 20 11:09:03.084913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 198/403] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:02 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:03.581635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:03.582330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:03.589441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:03.589887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:03.590779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:03.591221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:03.736067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:03.745480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fadc29cd-debd-4f44-b4ff-aaba9bffc596 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.167816 Jun 20 11:09:03.746192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 206/404] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:03 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:04.101869 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:04.102648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:04.109745 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:04.110219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:04.110978 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:04.111407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:04.261148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:04.269741 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-87c224e9-19ac-4a86-b3b0-34f9a27ea2b8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1442 microversion: 2.1 time: 0.171717 Jun 20 11:09:04.270388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 199/405] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:04 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1442 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:04.296523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:04.297133 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:04.304049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:04.304525 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:04.305334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:04.305765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:04.446531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:04.455335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-10cfcb9d-59a3-415e-b804-4c507db5f2a5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1442 microversion: 2.1 time: 0.164253 Jun 20 11:09:04.455914 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 207/406] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:04 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1442 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:04.763065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:04.763692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:04.770299 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:04.770760 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:04.771819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:04.772434 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:05.023202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:05.034626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0bd7ee78-df3f-457f-8b25-e63dc76fbc37 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.275424 Jun 20 11:09:05.048273 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 200/407] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:04 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:06.058357 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:06.058972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:06.062317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=57 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:09:06.068348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:06.068797 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:06.069578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:06.070012 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:06.208183 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:06.216872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c4a2b0af-6d90-4100-9de7-b6eb104636ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.162354 Jun 20 11:09:06.217457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 208/408] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:06 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:06.445762 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-4af033e1-eca0-4ae4-a124-8c380a125a77 req-9b462826-83d2-4fba-8f8e-2db5b26faa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:09:06.449531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:09:06.455930 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4af033e1-eca0-4ae4-a124-8c380a125a77 req-9b462826-83d2-4fba-8f8e-2db5b26faa4e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:06.456364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-4af033e1-eca0-4ae4-a124-8c380a125a77 req-9b462826-83d2-4fba-8f8e-2db5b26faa4e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:06.470544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-4af033e1-eca0-4ae4-a124-8c380a125a77 req-9b462826-83d2-4fba-8f8e-2db5b26faa4e service nova] Creating event network-changed:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:09:06.476330 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-4af033e1-eca0-4ae4-a124-8c380a125a77 req-9b462826-83d2-4fba-8f8e-2db5b26faa4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035625 Jun 20 11:09:06.477171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 201/409] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:09:07.234429 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:07.235355 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:07.243462 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:07.243915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:07.244696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:07.245130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:07.409881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:07.419378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-59c3dec2-8cd0-445c-b803-9eee441d9d5d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.188760 Jun 20 11:09:07.420075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 209/410] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:07 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:08.438896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:08.439883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:08.448026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:08.448615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:08.449612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:08.450221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:08.608307 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:08.617427 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2cb5b714-6777-4d46-bced-646f96680185 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.184046 Jun 20 11:09:08.617982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 202/411] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:08 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:09.639439 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:09.640025 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:09.647933 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:09.648466 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:09.649344 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:09.649856 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:09.805526 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:09.825223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-60a37704-6489-492a-8a76-1d8cc37dd410 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.189633 Jun 20 11:09:09.825793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 210/412] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:09 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:10.843922 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:10.844662 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:10.852565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:10.853236 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:10.854512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:10.855058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:11.000017 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:11.010995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0aa677b9-55cb-4ecd-acc7-816de0f5f51b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.170778 Jun 20 11:09:11.011630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 203/413] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:10 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:12.032412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:12.033025 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:12.039990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:12.040444 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:12.041210 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:12.041645 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:12.188779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:12.197150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b4df27ae-cd1a-4ee7-9f4a-765f76007eb8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.168938 Jun 20 11:09:12.197684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 211/414] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:12 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:13.215997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:13.216604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:13.223850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:13.224275 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:13.225049 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:13.225472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:13.363150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:13.372326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2441c06c-dfc0-45e1-abf3-8e1d7d94cf43 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.160309 Jun 20 11:09:13.372912 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 204/415] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:13 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:14.392940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:14.393774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:14.402664 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:14.403346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:14.404350 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:14.404895 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:14.548355 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:14.560159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f79a9078-8cb2-49aa-990d-0a25279333a9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.173584 Jun 20 11:09:14.560958 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 212/416] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:14 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:15.586828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:15.587858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:15.597296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:15.597731 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:15.598528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:15.598959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:15.749228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:15.758689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-05fef689-ea60-49ec-ada1-2815865af536 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.178133 Jun 20 11:09:15.759249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 205/417] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:15 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:16.777009 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:16.777675 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:16.784819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:16.785268 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:16.786032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:16.786491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:16.931523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:16.939723 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0a34e1d4-e440-4d64-85db-24d0ff9fa14b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.166638 Jun 20 11:09:16.940336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 213/418] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:16 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:17.964967 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:17.965792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:17.972294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:17.973033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:17.973800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:17.974283 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:18.126899 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:18.136033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c0859d9c-aa73-45fa-9bf7-58fd8775a487 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.177108 Jun 20 11:09:18.136702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 206/419] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:17 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:19.154838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:19.155454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:19.162690 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:19.163047 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:19.163826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:19.164259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:19.335027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:19.344841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-374f41a0-f397-4ea9-bd09-9c41391ab10d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1723 microversion: 2.1 time: 0.194292 Jun 20 11:09:19.345482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 214/420] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:19 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:20.363793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:20.364392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:20.372600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:20.373043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:20.373812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:20.374277 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:20.378640 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:09:20.695040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:20.701313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2a345680-10c8-41ba-aa37-7fcc9922316c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1700 microversion: 2.1 time: 0.342795 Jun 20 11:09:20.701916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 207/421] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:20 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1700 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:20.720137 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eca8ba31-3d35-49bd-9cf7-e16835936f2f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:09:20.727401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eca8ba31-3d35-49bd-9cf7-e16835936f2f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:20.727876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eca8ba31-3d35-49bd-9cf7-e16835936f2f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:20.790880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eca8ba31-3d35-49bd-9cf7-e16835936f2f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Going to try to start instance {{(pid=117605) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 11:09:20.795689 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:09:20.848459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eca8ba31-3d35-49bd-9cf7-e16835936f2f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action" status: 202 len: 0 microversion: 2.1 time: 0.133735 Jun 20 11:09:20.849265 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 215/422] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:09:20 2022] POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:09:20.859198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:20.860097 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:20.870034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:20.870385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:20.871380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:20.872047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:21.062042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:21.070833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f1020f79-2840-49f0-93a5-21d2eba8c132 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1709 microversion: 2.1 time: 0.216308 Jun 20 11:09:21.071419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 208/423] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:20 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1709 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:22.092013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:22.092740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:22.099968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:22.100412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:22.101178 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:22.101608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:22.307190 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:22.318143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2c76c754-72f4-4546-9273-57766a7a00c4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1709 microversion: 2.1 time: 0.231892 Jun 20 11:09:22.318739 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 216/424] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:22 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1709 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:23.340457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:23.341064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:23.349152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:23.349598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:23.350399 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:23.350834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:23.511241 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:23.521989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5fce2300-5fc8-4e93-90a9-2208697cba63 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1713 microversion: 2.1 time: 0.187744 Jun 20 11:09:23.522636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 209/425] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:23 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1713 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:24.638483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:24.639561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:24.650570 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:24.651097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:24.651879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:24.652456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:24.790520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lazy-loading 'services' on Instance uuid d13ba185-72e3-4e27-9041-9fb4f2377e5d {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:09:24.950786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b6fce10c-d55c-4b4f-a35c-08e1a91e0603 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d/os-volume_attachments/bd3e671c-0255-4483-883f-9bbdf86c14d2" status: 202 len: 0 microversion: 2.1 time: 0.319135 Jun 20 11:09:24.951404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 217/426] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:09:24 2022] DELETE /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d/os-volume_attachments/bd3e671c-0255-4483-883f-9bbdf86c14d2 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:09:26.100575 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:26.101145 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:26.107501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:26.107948 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:26.108707 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:26.109132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:26.134898 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:09:26.225031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8574c59-6868-4b54-9190-d5c4d21a7d5a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 204 len: 0 microversion: 2.1 time: 0.128121 Jun 20 11:09:26.225559 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 210/427] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:09:26 2022] DELETE /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:09:26.234232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:26.234924 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:26.241884 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:26.242360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:26.243112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:26.243547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:26.390480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:26.399237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bcc3f1d4-8af7-4306-9820-f06135b8602e tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1513 microversion: 2.1 time: 0.169221 Jun 20 11:09:26.399809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 218/428] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:26 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:27.424490 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:27.425176 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:27.432390 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:27.432761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:27.433522 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:27.433950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:27.582773 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:27.593047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c37273a6-4859-41e4-98c6-0f5bd793f35a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1513 microversion: 2.1 time: 0.174659 Jun 20 11:09:27.593934 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 211/429] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:27 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:09:28.616600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:28.617387 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:28.624576 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:28.625011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:28.625772 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:28.626230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:28.789276 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:28.800900 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-78e873f5-c94d-49b3-9270-3ad7fba2a99a tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1513 microversion: 2.1 time: 0.186172 Jun 20 11:09:28.801585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 219/430] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:28 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:29.369961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-035e4a5d-71f3-4adf-8558-0fd9b64cdd08 req-d335e818-68fe-4da9-b3d6-e208394c0497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13ba185-72e3-4e27-9041-9fb4f2377e5d", "name": "network-vif-deleted", "tag": "e5351d90-87f7-483a-bef4-d9884b0a07b3"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:09:29.378550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-035e4a5d-71f3-4adf-8558-0fd9b64cdd08 req-d335e818-68fe-4da9-b3d6-e208394c0497 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:29.378969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-035e4a5d-71f3-4adf-8558-0fd9b64cdd08 req-d335e818-68fe-4da9-b3d6-e208394c0497 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:29.390915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-035e4a5d-71f3-4adf-8558-0fd9b64cdd08 req-d335e818-68fe-4da9-b3d6-e208394c0497 service nova] Creating event network-vif-deleted:e5351d90-87f7-483a-bef4-d9884b0a07b3 for instance d13ba185-72e3-4e27-9041-9fb4f2377e5d on hv-cinder-84614 Jun 20 11:09:29.396379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-035e4a5d-71f3-4adf-8558-0fd9b64cdd08 req-d335e818-68fe-4da9-b3d6-e208394c0497 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030493 Jun 20 11:09:29.397595 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 212/431] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:09:29.821351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:29.822066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:29.830868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:29.831350 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:29.832240 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:29.832886 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:29.871751 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:29.872183 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:29.872632 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lazy-loading 'fault' on Instance uuid d13ba185-72e3-4e27-9041-9fb4f2377e5d {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:09:29.920359 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a96fa98fa00c4de29a9bed22ed9e597b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd47c143cf33a41799202d5f7d90a66b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:09:29.929483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7d1b6452-2423-40b0-bf91-4fabb5995c13 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 200 len: 1309 microversion: 2.1 time: 0.113877 Jun 20 11:09:29.930180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 220/432] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:29 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:09:30.948690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:09:30.949414 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] [instance: d13ba185-72e3-4e27-9041-9fb4f2377e5d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:09:30.957701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:30.958369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:30.959155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:09:30.959592 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:09:30.973023 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:09:30.973605 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:09:30.974310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] HTTP exception thrown: Instance d13ba185-72e3-4e27-9041-9fb4f2377e5d could not be found. Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Request method failure captured: Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d HTTP/1.1 Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFSEWGUrOyNrIp7H5v2aPGdzBWscJhkWeHmI3sQuVnPY8_AoHBxhOVZQinAdCO8prfVkQlu9sXQOITGWn_irwGvk0KyLc2NJ5OubYn5GA5PBtZvDzsM4t1GlgFKU7b5EwDVQyicNt9UH-AXBv7Mc5DD3tNsJ172XRS3iA5hrb8kzuUI Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: d47c143cf33a41799202d5f7d90a66b5 Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2065443662 Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:09:30.975995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d47c143cf33a41799202d5f7d90a66b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotTestJSON-2065443662 Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: d47c143cf33a41799202d5f7d90a66b5 Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2065443662 Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotTestJSON-2065443662-project Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: a96fa98fa00c4de29a9bed22ed9e597b Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotTestJSON-2065443662-project Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance d13ba185-72e3-4e27-9041-9fb4f2377e5d could not be found. Jun 20 11:09:30.977364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'd13ba185-72e3-4e27-9041-9fb4f2377e5d'} Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13ba185-72e3-4e27-9041-9fb4f2377e5d could not be found. Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:09:30.979656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13ba185-72e3-4e27-9041-9fb4f2377e5d could not be found. Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13ba185-72e3-4e27-9041-9fb4f2377e5d could not be found. Jun 20 11:09:30.980923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:09:30.982279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] Returning 404 to user: Instance d13ba185-72e3-4e27-9041-9fb4f2377e5d could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:09:30.982279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ef73fc0a-1169-4e95-9177-62a12645f0f5 tempest-VolumesSnapshotTestJSON-2065443662 tempest-VolumesSnapshotTestJSON-2065443662-project] 10.222.0.33 "GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d" status: 404 len: 111 microversion: 2.1 time: 0.034005 Jun 20 11:09:30.982279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 213/433] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:09:30 2022] GET /compute/v2.1/servers/d13ba185-72e3-4e27-9041-9fb4f2377e5d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:10:18.197995 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-016f7b3e-8db1-4a1f-a5df-d14dcd902919 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Action: 'create', calling method: .version_select at 0x7f72153715e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-8892953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm4IA6vv5vlSPdNWJAqtPNr/QXL7N7ld6GWvRO10MuKrI6dlajPsfsx74hz1dWugfrZYN2l1zH5+3RI1hjjJCywvVjtqOoOxo5xDdMb7h1YwLbtmPCk1CPuIUDTBysOaQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:18.202213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=27 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:18.202834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:18.216540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-016f7b3e-8db1-4a1f-a5df-d14dcd902919 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Getting quotas for project fdaa800381f948619a950d65f637c16a. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:10:18.220894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-016f7b3e-8db1-4a1f-a5df-d14dcd902919 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Getting quotas for user ca6820ed031b49a8b3f6cff4ad7a899d and project fdaa800381f948619a950d65f637c16a. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:10:18.249487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-016f7b3e-8db1-4a1f-a5df-d14dcd902919 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055521 Jun 20 11:10:18.250386 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 221/434] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:10:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:10:18.303380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-948348763", "imageRef": "c351e3f0-4fc7-40c0-9b61-0d6346a72824", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-8892953", "networks": [{"uuid": "13e24735-9565-4428-ab7f-574948d0a62b"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:18.315371 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:18.316090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:18.371356 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] validate_networks() for [('13e24735-9565-4428-ab7f-574948d0a62b', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:10:18.876363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:10:18.876811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:10:18.877298 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:10:18.877707 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:10:18.878122 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:10:18.887504 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:18.887935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:18.888718 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:18.889140 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:18.906432 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Getting quotas for project fdaa800381f948619a950d65f637c16a. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:10:18.910585 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Getting quotas for user ca6820ed031b49a8b3f6cff4ad7a899d and project fdaa800381f948619a950d65f637c16a. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:10:18.922933 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:10:18.925124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c351e3f0-4fc7-40c0-9b61-0d6346a72824',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:10:18.973091 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11abf887-8cee-4e57-b724-af586b2cd1bf tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675163 Jun 20 11:10:18.973754 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 214/435] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:10:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:10:18.984841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9b03167c-4a32-46d9-8f04-2e9c561089ef tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:18.985443 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9b03167c-4a32-46d9-8f04-2e9c561089ef tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:19.042529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9b03167c-4a32-46d9-8f04-2e9c561089ef tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:19.050479 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9b03167c-4a32-46d9-8f04-2e9c561089ef tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1255 microversion: 2.1 time: 0.068847 Jun 20 11:10:19.050997 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 222/436] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:18 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1255 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:20.069870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:20.070555 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:20.079055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:20.079433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:20.080487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:20.081092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:20.155349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:20.164201 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e433296-c5e9-49f0-9092-7cd7d2b89d18 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1307 microversion: 2.1 time: 0.099894 Jun 20 11:10:20.165245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 215/437] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:20 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:21.182330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:21.183602 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:21.192179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:21.192899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:21.193939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:21.194549 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:21.343493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:21.351628 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dd53a847-86e1-4720-965c-de09ef6419f5 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.174397 Jun 20 11:10:21.352307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 223/438] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:21 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:22.370457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:22.371090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:22.377813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:22.378271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:22.379059 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:22.379487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:22.524795 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:22.532789 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88abe743-1d07-4741-af78-2c997a744e49 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.166920 Jun 20 11:10:22.533361 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 216/439] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:22 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:23.551511 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:23.552108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:23.559173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:23.559616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:23.560378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:23.560815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:23.702743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:23.710642 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9dfb0372-4be7-4050-82d9-cd1d0bf1d897 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.163714 Jun 20 11:10:23.711438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 224/440] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:23 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:24.727947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:24.728602 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:24.735342 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:24.735818 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:24.736590 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:24.736985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:24.878380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:24.888091 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0aaa17ae-164b-4a2d-8b82-cd0b5bfd5970 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.164625 Jun 20 11:10:24.888663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 217/441] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:24 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:25.907508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:25.908484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:25.916079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:25.916529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:25.917411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:25.917758 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:26.059044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:26.068128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-25f9ddb4-162b-4587-afc7-bc79bbdc7d8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.165752 Jun 20 11:10:26.068916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 225/442] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:25 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:27.087307 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:27.088613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:27.096052 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:27.096483 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:27.097252 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:27.097679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:27.235501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:27.243977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d881268d-bbec-4bd0-a1c3-d009dc4dbf9a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.161866 Jun 20 11:10:27.244643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 218/443] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:27 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:28.005962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "115ac765-06e9-4649-b9e9-f1e80e89fcbe"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:28.007125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:28.013880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:28.014353 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:28.015120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:28.015546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:28.262037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:28.263788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:28.271113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:28.271749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:28.272877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:28.273840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:28.423846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:28.431891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b789d16-f820-4e12-8032-0f30e169024d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.174129 Jun 20 11:10:28.432705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 219/444] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:28 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:29.047326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:29.450038 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:29.450676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:29.452607 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:29.453261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:29.459306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:29.459776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:29.460534 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:29.460991 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:29.599640 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:29.608869 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-81a4642a-0155-4941-9bd1-3eb0a6c64111 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.163702 Jun 20 11:10:29.609507 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 220/445] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:29 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:30.629935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:30.631880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:30.645490 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:30.646125 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:30.647171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:30.647653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:31.124189 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:31.135432 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b29d095-4c26-4326-97b8-bb63e07d7f10 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.512637 Jun 20 11:10:31.136272 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 221/446] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:30 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:32.154278 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:32.155076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:32.161839 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:32.162253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:32.163034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:32.163493 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:32.305708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:32.315658 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d5306ff7-e174-4226-b497-cdf1f0a5eee9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.165764 Jun 20 11:10:32.316253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 222/447] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:32 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:33.337116 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:33.338226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:33.349257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:33.350047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:33.351420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:33.352166 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:33.503374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:33.511866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1376d980-80c8-4c82-ae47-ccbd03f8355c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.181775 Jun 20 11:10:33.512578 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 223/448] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:33 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:34.530847 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:34.531777 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:34.538655 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:34.539189 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:34.540028 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:34.540495 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:34.678517 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-99cd4751-18ec-4c9a-b5cd-80a7a0a76cf6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.860055 Jun 20 11:10:34.679235 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 226/449] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:10:27 2022] POST /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments => generated 194 bytes in 6862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:10:34.911841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:34.922268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99903d91-4eb4-4aac-90fc-c79c01abb961 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.395745 Jun 20 11:10:34.931680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 224/450] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:34 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:35.677297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:35.678018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:35.685637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:35.686360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:35.686893 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:35.687376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:35.795043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lazy-loading 'services' on Instance uuid fe316d92-1158-4b44-b5c6-1c7c37e4c10d {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:10:35.922629 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c4568e4b-c2df-4e7a-9d13-3e36f522589a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-volume_attachments/ad6e797f-83ed-4616-b9e9-421d874d732a" status: 202 len: 0 microversion: 2.1 time: 0.381693 Jun 20 11:10:35.923980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 227/451] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:10:35 2022] DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-volume_attachments/ad6e797f-83ed-4616-b9e9-421d874d732a => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:10:35.968440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:35.969692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:35.978702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-ae8fc4dd-818f-44fc-8e99-bcdf070eb678 req-015a7649-258c-4438-8efd-bbac410b9e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:35.989248 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ae8fc4dd-818f-44fc-8e99-bcdf070eb678 req-015a7649-258c-4438-8efd-bbac410b9e25 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:35.989687 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-ae8fc4dd-818f-44fc-8e99-bcdf070eb678 req-015a7649-258c-4438-8efd-bbac410b9e25 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:35.994134 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:35.994887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:35.996136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:35.996942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:36.004581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-ae8fc4dd-818f-44fc-8e99-bcdf070eb678 req-015a7649-258c-4438-8efd-bbac410b9e25 service nova] Creating event network-changed:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:10:36.024859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-ae8fc4dd-818f-44fc-8e99-bcdf070eb678 req-015a7649-258c-4438-8efd-bbac410b9e25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165301 Jun 20 11:10:36.025748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 225/452] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:10:36.164865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:36.176293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0eef3bdf-fc88-4cb1-8411-90f5ed89a8b9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.232322 Jun 20 11:10:36.177335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 228/453] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:35 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:37.199372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:37.200078 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:37.207245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:37.207689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:37.208459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:37.208890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:37.357066 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:37.368866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-455a074a-1e24-4f5c-b58a-36e74ecd0f9e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.173805 Jun 20 11:10:37.369468 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 226/454] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:37 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:38.385491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:38.386176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:38.394010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:38.394492 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:38.395273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:38.395702 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:38.544682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:38.553474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b255a0b-7c86-4552-b049-e39702faa481 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.172163 Jun 20 11:10:38.554045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 229/455] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:38 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:39.571585 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:39.572627 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:39.580346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:39.580792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:39.581565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:39.583636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:39.761012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:39.769146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1c2fcb55-c08f-42e7-8b3b-62bd9e91f3e4 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.201957 Jun 20 11:10:39.769730 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 227/456] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:39 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:40.791762 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:40.792449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:40.800133 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:40.800679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:40.801705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:40.802299 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:40.962130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:40.970504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cffa5951-5e96-423e-ba42-23f4561a2efc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.183192 Jun 20 11:10:40.971094 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 230/457] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:40 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:41.492789 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f4a6be43-85a3-4642-82e8-0dbf5f09da9a req-6f9887e1-7886-4e6f-a62a-f5edffb82ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "name": "network-vif-plugged", "status": "completed", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:41.511615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f4a6be43-85a3-4642-82e8-0dbf5f09da9a req-6f9887e1-7886-4e6f-a62a-f5edffb82ddc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:41.512115 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f4a6be43-85a3-4642-82e8-0dbf5f09da9a req-6f9887e1-7886-4e6f-a62a-f5edffb82ddc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:41.526548 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f4a6be43-85a3-4642-82e8-0dbf5f09da9a req-6f9887e1-7886-4e6f-a62a-f5edffb82ddc service nova] Creating event network-vif-plugged:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:10:41.532656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f4a6be43-85a3-4642-82e8-0dbf5f09da9a req-6f9887e1-7886-4e6f-a62a-f5edffb82ddc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118033 Jun 20 11:10:41.534032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 228/458] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:10:41.988098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:41.988942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:41.995695 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:41.996308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:41.997411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:41.997920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.140516 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:42.148294 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-911b54a5-56b2-4aad-917f-d1b11333c54b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.164115 Jun 20 11:10:42.148884 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 231/459] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:41 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:42.276049 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:42.277082 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:42.284763 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.285235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.286047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.286532 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.312812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lazy-loading 'flavor' on Instance uuid fda5e0fc-11d3-4bd6-ab13-5403531f371f {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:10:42.451564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cb645bbc-4a4e-41fb-a455-af415b3c3c8b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:42.459021 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cb645bbc-4a4e-41fb-a455-af415b3c3c8b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.459560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cb645bbc-4a4e-41fb-a455-af415b3c3c8b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.483770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-73c64e98-5d45-4364-92cf-f754e4452af3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/action" status: 200 len: 32 microversion: 2.1 time: 0.211756 Jun 20 11:10:42.484515 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 229/460] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:10:42 2022] POST /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:10:42.488735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cb645bbc-4a4e-41fb-a455-af415b3c3c8b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Going to try to stop instance {{(pid=117605) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 11:10:42.496495 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:42.497995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:42.505534 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.505982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.506808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.507406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.528199 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:42.560336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cb645bbc-4a4e-41fb-a455-af415b3c3c8b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action" status: 202 len: 0 microversion: 2.1 time: 0.112581 Jun 20 11:10:42.561508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 232/461] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:10:42 2022] POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:10:42.576386 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:42.577711 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:42.585072 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.585501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.586308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:42.586733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:42.688679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:42.704576 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6d238cfc-3a12-4c3b-90e0-787f6df119d7 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.212153 Jun 20 11:10:42.705254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 230/462] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:42 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:42.736259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:42.744428 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aa0eccad-16a4-441b-b5cb-4a07fdb02359 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.175200 Jun 20 11:10:42.745043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 233/463] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:42 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:43.166347 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:43.166964 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:43.174238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:43.174821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:43.175572 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:43.176036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:43.395297 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:43.407329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8cbc4419-59f1-4651-90a1-399476fbe78a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1355 microversion: 2.1 time: 0.244909 Jun 20 11:10:43.407937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 231/464] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:43 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1355 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:43.722634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:43.723242 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:43.730850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:43.731297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:43.732090 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:43.732528 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:43.765316 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:43.766292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:43.774483 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:43.775058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:43.775950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:43.776559 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:43.931698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:43.945157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d3906778-4e6f-4e48-b5f9-669ee3e9170a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.224431 Jun 20 11:10:43.945157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 234/465] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:43 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:44.037885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:44.052646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d8a8d62a-f6e2-46b2-b1a2-b97ea3d2f300 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.292003 Jun 20 11:10:44.053299 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 232/466] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:43 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:44.424873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:44.425379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:44.432324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.432799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.433582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.434014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.578956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:44.588289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-76e45c0f-0f73-4bdd-a129-f3a7fca80f0c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1545 microversion: 2.1 time: 0.167408 Jun 20 11:10:44.588856 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 235/467] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:44 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:44.605099 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:44.605692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:44.612686 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.613138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.613950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.614443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.755336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:44.763560 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-284e1879-0c8b-4046-be2c-6b1803120b40 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1545 microversion: 2.1 time: 0.162320 Jun 20 11:10:44.764374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 233/468] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:44 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1545 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:44.779789 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:44.783575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:44.784358 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Searching by: {'deleted': False, 'project_id': 'fdaa800381f948619a950d65f637c16a'} {{(pid=117605) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 11:10:44.792049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.792501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.793306 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.793745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.891765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.multi_cell_list [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117605) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 11:10:44.918349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:44.961407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:44.962045 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:44.968726 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.969228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.969958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:44.970523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:44.991329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6a86f1fe-3114-4c0f-96f1-40df2da3f387 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215335 Jun 20 11:10:44.992096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 236/469] 10.222.0.33 () {58 vars in 1124 bytes} [Mon Jun 20 11:10:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:10:45.004635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:45.005318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:45.012384 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:45.012870 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:45.014069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:45.014260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:45.129031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:45.140397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d0b5565d-b201-4992-88b0-0c585528edf4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.183138 Jun 20 11:10:45.141004 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 234/470] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:44 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:45.145990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:45.146651 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:45.153046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:45.153496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:45.154310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:45.155555 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:45.164294 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:45.172493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a98fc392-3cd8-44bb-92b3-9778c6b76419 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1545 microversion: 2.1 time: 0.173485 Jun 20 11:10:45.173368 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 237/471] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:44 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1545 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:45.297257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:45.307113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e5b8f134-5ee0-486b-8c90-5d27ae1b64d4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.164160 Jun 20 11:10:45.307243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 235/472] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:45 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:46.161405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:46.161993 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:46.172928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:46.173368 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:46.174204 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:46.174638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:46.325133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:46.325917 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:46.332497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:46.332969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:46.333772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:46.334235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:46.345949 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:46.354602 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fa5d4dc6-9caa-43e9-8413-6dd7bb1edc71 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.197633 Jun 20 11:10:46.355182 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 238/473] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:46 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:46.474644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:46.485598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f8380a33-a2b2-4957-8490-8409508eafe6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.164329 Jun 20 11:10:46.486229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 236/474] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:46 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:46.762644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fd9a295-7b01-4ad5-824d-c836ebdbca1a"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:46.763758 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:46.770592 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:46.771040 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:46.771822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:46.772257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:47.041311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d514fa91-d5d9-4dcf-a852-c384cd38ae70 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282740 Jun 20 11:10:47.041918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 239/475] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:10:46 2022] POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:10:47.371940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:47.372600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:47.379827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:47.380285 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:47.381085 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:47.381525 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:47.504412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:47.505122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:47.511752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:47.512211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:47.513010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:47.513462 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:47.526404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:47.536489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f4d42bf0-154a-448b-815a-d3ba55f66a91 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.168521 Jun 20 11:10:47.547238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 237/476] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:47 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:47.669036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:47.678235 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4cdc4805-69da-40fd-b944-aab6bb63980b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.178839 Jun 20 11:10:47.678824 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 240/477] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:47 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:48.554766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:48.555433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:48.557280 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:48.563320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:48.564110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:48.564951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:48.565315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:48.697715 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:48.698551 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:48.701157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:48.708112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:48.708482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:48.709266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:48.709726 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:48.712009 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:48.723073 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ecffb4f2-8985-4e65-9c2c-1943a50aa33c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.172101 Jun 20 11:10:48.723671 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 238/478] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:48 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:48.872659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:48.887110 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a2918082-c074-4318-a0fe-e97534cfd54b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.194204 Jun 20 11:10:48.887726 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 241/479] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:48 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:49.741020 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:49.741949 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:49.749896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:49.750385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:49.751170 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:49.751600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:49.892411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:49.902158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a3e8745f-f762-4b12-836a-80ac4de8a04a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.165191 Jun 20 11:10:49.905117 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 239/480] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:49 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:49.906275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:49.907566 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:49.915595 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:49.916174 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:49.917066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:49.917587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:50.060561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:50.069387 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a7287778-e1b6-4cda-9e7c-773724ab2621 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.167213 Jun 20 11:10:50.069957 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 242/481] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:49 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:50.921340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:50.922077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:50.928770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:50.929251 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:50.930038 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:50.930542 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:51.071759 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:51.080513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-11c88c13-fa7e-43d3-9dba-4a5f295e30c3 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.163208 Jun 20 11:10:51.081081 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 240/482] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:50 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:51.089650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:51.090334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:51.097819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:51.098398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:51.099262 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:51.099733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:51.242250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:51.251311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c7a7c97f-ab45-441d-91cb-bf338c6374da tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.165908 Jun 20 11:10:51.251918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 243/483] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:51 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:52.100385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:52.100993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:52.108105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:52.108637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:52.109475 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:52.109904 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:52.251930 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:52.260677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2cba5d81-1b8c-43ff-9d08-f9483e296fca tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.164183 Jun 20 11:10:52.261261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 241/484] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:52 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:52.268584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:52.269150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:52.276413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:52.276845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:52.277623 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:52.278058 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:52.435068 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:52.443485 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a2741082-d59f-4db2-813f-783d9eac221f tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.178684 Jun 20 11:10:52.444114 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 244/485] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:52 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:53.277898 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:53.278570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:53.285001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:53.285452 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:53.286244 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:53.286690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:53.439932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:53.448969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c542e09c-1efe-4ef0-ae57-d4d684e0881d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.174859 Jun 20 11:10:53.449538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 242/486] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:53 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:53.461980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:53.462690 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:53.469815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:53.470295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:53.471085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:53.471506 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:53.621907 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:53.632413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-81dda739-c6bf-4b97-8162-2d8fd0c92e17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.174793 Jun 20 11:10:53.633473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 245/487] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:53 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:54.469900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:54.470609 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:54.480143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:54.480143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:54.480143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:54.480143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:54.633580 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:54.643582 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f234f116-0796-4760-8616-8c3bbe5b040d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.180391 Jun 20 11:10:54.644139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 243/488] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:54 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:54.654801 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:54.656168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:54.663291 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:54.664029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:54.664804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:54.665331 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:54.673044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:54.673692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:54.682557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:54.683157 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:54.683924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:54.684154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:54.823888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:54.829524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:54.836195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-204fdf02-7051-464a-9900-f16467e7f58e tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.185474 Jun 20 11:10:54.836790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 246/489] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:54 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:54.851287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:54.861418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e262f477-3c4b-4bbd-9c63-a7e541fb9415 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1591 microversion: 2.1 time: 0.192725 Jun 20 11:10:54.862069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 244/490] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:54 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1591 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:55.665045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:55.666119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:55.674671 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:55.675426 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:55.677101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:55.677865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:55.859841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:55.860702 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:55.860909 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:55.869075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:55.869809 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:55.870898 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:55.871420 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7937b567-ec85-40d2-b4d0-1d71fc9589f0 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.211796 Jun 20 11:10:55.871620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:55.872393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 247/491] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:55 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:56.123462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:56.131879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-972e5343-dc22-474f-a3f4-3cbd52570c71 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.278731 Jun 20 11:10:56.132493 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 245/492] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:55 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:56.897543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:56.898279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:56.905811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:56.906343 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:56.907130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:56.908606 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:57.056478 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:57.064264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-8a0b6774-45f3-42f1-9ea6-e82516855eb2 req-26789234-8b56-4c0c-b428-b00fa062bdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:57.067476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-502b6bae-6ba1-4d14-a044-cdffcb9595ad tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.173941 Jun 20 11:10:57.068573 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 248/493] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:56 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:57.075833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8a0b6774-45f3-42f1-9ea6-e82516855eb2 req-26789234-8b56-4c0c-b428-b00fa062bdb9 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:57.076632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8a0b6774-45f3-42f1-9ea6-e82516855eb2 req-26789234-8b56-4c0c-b428-b00fa062bdb9 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:57.092953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-8a0b6774-45f3-42f1-9ea6-e82516855eb2 req-26789234-8b56-4c0c-b428-b00fa062bdb9 service nova] Creating event network-changed:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:10:57.103791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-8a0b6774-45f3-42f1-9ea6-e82516855eb2 req-26789234-8b56-4c0c-b428-b00fa062bdb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043993 Jun 20 11:10:57.106349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 246/494] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:10:57.152326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:57.152967 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:57.163059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:57.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:57.165089 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:57.165530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:57.357380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:57.368528 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-331ce93e-9b70-4bc7-85a5-19fd47d6f640 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.220720 Jun 20 11:10:57.369546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 249/495] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:57 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:58.089186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:58.089925 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:58.096840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:58.097296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:58.098100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:58.098553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:58.284408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:58.288493 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:58.294982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-160deed0-6cae-43e2-8e31-4b2dc154a7fe tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.209928 Jun 20 11:10:58.296798 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 247/496] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:58 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:58.376898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-108185545"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:58.377638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:58.384833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:58.385592 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:58.386405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:58.386532 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:58.386836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:58.387192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:58.396561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:58.397366 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:58.398973 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:58.399987 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:58.541835 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.network.security_group_api [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Adding security group abf9203b-5b39-4977-a8ca-f38a8d03a8a3 to port ab81e9b0-cbd5-41b5-be2d-efcb9c31940f Jun 20 11:10:58.565457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:58.574076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-92c63e09-6558-405f-a402-756b89aa0326 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1677 microversion: 2.1 time: 0.191883 Jun 20 11:10:58.574689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 248/497] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:58 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:58.969950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a10ae3eb-e442-4e64-b072-728494b261be tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/action" status: 202 len: 0 microversion: 2.1 time: 0.597647 Jun 20 11:10:58.971634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 250/498] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:10:58 2022] POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:10:58.985111 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:58.985750 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:58.997578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.003032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.003880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.004324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.064335 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f016f542-24c9-403d-bcb3-5fe267ea5d01 req-1b9b83b5-e875-4fea-b2aa-d14e3726ad8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:59.073722 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f016f542-24c9-403d-bcb3-5fe267ea5d01 req-1b9b83b5-e875-4fea-b2aa-d14e3726ad8b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.074212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f016f542-24c9-403d-bcb3-5fe267ea5d01 req-1b9b83b5-e875-4fea-b2aa-d14e3726ad8b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.093086 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f016f542-24c9-403d-bcb3-5fe267ea5d01 req-1b9b83b5-e875-4fea-b2aa-d14e3726ad8b service nova] Creating event network-changed:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:10:59.101284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f016f542-24c9-403d-bcb3-5fe267ea5d01 req-1b9b83b5-e875-4fea-b2aa-d14e3726ad8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126734 Jun 20 11:10:59.102409 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 249/499] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:10:59.209173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:59.216298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:10:59.220734 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d825b988-fd5d-41a4-b8a1-1f65f25557e2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1755 microversion: 2.1 time: 0.245416 Jun 20 11:10:59.221928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 251/500] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:58 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:10:59.315923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:59.316940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:59.326744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.327661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.328950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.329628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.544175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:59.556689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-50336937-3505-4db5-ba1f-15b743d23feb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.246575 Jun 20 11:10:59.557354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 250/501] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:59 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:59.594895 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:59.595604 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:59.604329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.605068 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.606035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.606493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.772069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:10:59.780741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-13ea87af-3a5a-4061-a453-800173aadd6b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1654 microversion: 2.1 time: 0.190455 Jun 20 11:10:59.793412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 252/502] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:59 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1654 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:10:59.799537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13c4bb70-7592-40d1-b81f-7a45c9eec62c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:10:59.806435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13c4bb70-7592-40d1-b81f-7a45c9eec62c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.806886 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13c4bb70-7592-40d1-b81f-7a45c9eec62c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.831770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13c4bb70-7592-40d1-b81f-7a45c9eec62c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Going to try to start instance {{(pid=117606) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 11:10:59.877094 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13c4bb70-7592-40d1-b81f-7a45c9eec62c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action" status: 202 len: 0 microversion: 2.1 time: 0.082344 Jun 20 11:10:59.879860 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 251/503] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:10:59 2022] POST /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:10:59.891660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:10:59.892267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:10:59.899990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.900547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:10:59.901338 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:10:59.901842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:00.049864 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:00.059061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7d5bc0e8-2cf3-41fe-912d-563ae3890675 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1663 microversion: 2.1 time: 0.174304 Jun 20 11:11:00.059818 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 253/504] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:10:59 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:00.536650 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:11:00.537198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:11:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:11:00.579890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:00.581138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:00.587962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:00.588396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:00.589190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:00.589723 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:00.732962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:00.742368 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aecfde43-e4f1-4c05-8a1f-76e0ac0e879d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.166769 Jun 20 11:11:00.743082 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 252/505] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:00 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:01.084052 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:01.085385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:01.097347 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:01.098324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:01.099604 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:01.100289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:01.247546 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:01.255613 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5601ab97-0f31-4500-8e04-8c4f4d45c332 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1667 microversion: 2.1 time: 0.179915 Jun 20 11:11:01.256196 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 254/506] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:01 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1667 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:01.761981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:01.762585 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:01.770413 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:01.770859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:01.771629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:01.772044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:01.922422 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:01.931942 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8f3806b-6db7-47bc-9eac-fabb4c272aaa tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.173758 Jun 20 11:11:01.932829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 253/507] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:01 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:02.953678 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:02.954313 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:02.961490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:02.961967 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:02.962782 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:02.963215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:03.108707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:03.117340 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c50e83b5-29d1-43ee-87fb-0064b610496e tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.168973 Jun 20 11:11:03.117889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 255/508] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:02 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:04.135946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:04.136675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:04.144415 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:04.144857 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:04.145619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:04.146042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:04.289186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:04.298658 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a195453-abb3-4433-b2fb-ecc597ddee39 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.167109 Jun 20 11:11:04.299220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 254/509] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:04 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:05.318007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:05.318680 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:05.325510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:05.325962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:05.327521 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:05.327954 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:05.471559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:05.482788 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d1b95aa4-1e8c-47f8-8aaf-c9c09ce0a979 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.168966 Jun 20 11:11:05.483489 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 256/510] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:05 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:06.500816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:06.501428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:06.508109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:06.509604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:06.509604 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:06.509806 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:06.648689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:06.657276 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-038cace2-ddee-4e19-a5df-0c131519af4d tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.160959 Jun 20 11:11:06.657862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 255/511] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:06 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:07.676431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:07.677870 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:07.683897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:07.684347 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:07.685115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:07.685541 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:07.828092 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:07.836741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a18990dd-1784-4ab5-b9c3-9d85ae35dd2f tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1735 microversion: 2.1 time: 0.164944 Jun 20 11:11:07.837627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 257/512] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:07 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:08.854529 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:08.855134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:08.861584 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:08.862027 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:08.862820 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:08.863247 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.006148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:09.017119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3228ddee-85a7-4058-b96a-c533faff0a57 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1715 microversion: 2.1 time: 0.166518 Jun 20 11:11:09.017678 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 256/513] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:08 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:09.083739 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:09.084305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:09.091153 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:09.091584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.092330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:09.092746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.182050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] HTTP exception thrown: Cannot 'detach_volume' instance fda5e0fc-11d3-4bd6-ab13-5403531f371f while it is in vm_state rescued Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Request method failure captured: Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments/115ac765-06e9-4649-b9e9-f1e80e89fcbe HTTP/1.1 Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ_azYavfpigFciMQdM673oO9M66LVlpfO6vi7JL7r0LFufoaT1eEo1Dp0ARIxFX3dsQ3eOG3gEcrSgZGaM7cMjLoetGkR1t0c8Ll8rEeLGLCoDJWdgjU1bagtAIwcAfQ3AE4eoc0RQSN5PWNrwAu38__EiGThC8z8ETCVlSIfvb_w Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:11:09.185098 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 0c4a4ce86beb47c2b7910264a9238c8b Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:11:09.186810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Cannot 'detach_volume' instance fda5e0fc-11d3-4bd6-ab13-5403531f371f while it is in vm_state rescued Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'server_id': 'fda5e0fc-11d3-4bd6-ab13-5403531f371f', 'id': '115ac765-06e9-4649-b9e9-f1e80e89fcbe'} Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:11:09.187509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fda5e0fc-11d3-4bd6-ab13-5403531f371f while it is in vm_state rescued Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fda5e0fc-11d3-4bd6-ab13-5403531f371f while it is in vm_state rescued Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:11:09.189096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Returning 409 to user: Cannot 'detach_volume' instance fda5e0fc-11d3-4bd6-ab13-5403531f371f while it is in vm_state rescued {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:11:09.190820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0e3c8ac5-8e4d-44b9-909e-c8e95364acc6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments/115ac765-06e9-4649-b9e9-f1e80e89fcbe" status: 409 len: 152 microversion: 2.1 time: 0.107529 Jun 20 11:11:09.190820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 258/514] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:11:09 2022] DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments/115ac765-06e9-4649-b9e9-f1e80e89fcbe => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:11:09.201580 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:09.202722 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:09.210940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:09.211382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.212151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:09.212573 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.281513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0aaaee05-060c-419a-a43e-cec929e24fba tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "POST /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/action" status: 202 len: 0 microversion: 2.1 time: 0.087268 Jun 20 11:11:09.282208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 257/515] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:11:09 2022] POST /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:11:09.291700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:09.292314 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:09.301740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:09.302234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.303020 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:09.303464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:09.449880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:09.459914 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-72b54e50-b211-47ef-97fb-02d14d65efc4 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1723 microversion: 2.1 time: 0.171961 Jun 20 11:11:09.460511 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 259/516] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:09 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:10.479502 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:10.480119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:10.487808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:10.488254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:10.489023 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:10.489455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:10.637571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:10.646808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7e4dfdf1-02f9-4d62-a4d5-0b8fdd66a463 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1723 microversion: 2.1 time: 0.171770 Jun 20 11:11:10.647835 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 258/517] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:10 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:11.666390 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:11.667003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:11.674842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:11.675276 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:11.676021 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:11.676440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:11.818321 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:11.826762 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-90e57db8-c6e7-40e2-b70c-008634a0ed06 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1723 microversion: 2.1 time: 0.164650 Jun 20 11:11:11.827352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 260/518] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:11 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:12.844811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:12.845450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:12.853787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:12.854621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:12.855849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:12.856538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:12.998254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:13.008406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0ebbf4c-d9e8-4eed-bdd3-f7df0f390cbb tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1729 microversion: 2.1 time: 0.167480 Jun 20 11:11:13.009446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 259/519] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:12 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:13.027028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:13.027626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:13.034998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:13.035444 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:13.036223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:13.036634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:13.116976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-55bade10-fc7f-4695-bc52-8a3cecbc23b8 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093810 Jun 20 11:11:13.117606 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 261/520] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:11:13 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:14.087447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-40e7d28d-6630-44f0-b6b5-d7d8545295f2 req-e471b611-328f-4515-82a8-979674a8266f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda5e0fc-11d3-4bd6-ab13-5403531f371f", "tag": "6ca3af82-3d2d-4c59-b7dc-43cea11de78e"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:14.099630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-40e7d28d-6630-44f0-b6b5-d7d8545295f2 req-e471b611-328f-4515-82a8-979674a8266f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:14.100069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-40e7d28d-6630-44f0-b6b5-d7d8545295f2 req-e471b611-328f-4515-82a8-979674a8266f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:14.113387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-40e7d28d-6630-44f0-b6b5-d7d8545295f2 req-e471b611-328f-4515-82a8-979674a8266f service nova] Creating event network-changed:6ca3af82-3d2d-4c59-b7dc-43cea11de78e for instance fda5e0fc-11d3-4bd6-ab13-5403531f371f on hv-cinder-84614 Jun 20 11:11:14.118478 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-40e7d28d-6630-44f0-b6b5-d7d8545295f2 req-e471b611-328f-4515-82a8-979674a8266f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034760 Jun 20 11:11:14.119291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 260/521] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:16.136289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-4d817dac-b460-40d3-a08a-0cfeb671e0c2 req-66ac0fe2-f682-4a11-ae86-91550ef719ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda5e0fc-11d3-4bd6-ab13-5403531f371f", "tag": "6ca3af82-3d2d-4c59-b7dc-43cea11de78e"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:16.147116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-4d817dac-b460-40d3-a08a-0cfeb671e0c2 req-66ac0fe2-f682-4a11-ae86-91550ef719ae service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:16.147578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-4d817dac-b460-40d3-a08a-0cfeb671e0c2 req-66ac0fe2-f682-4a11-ae86-91550ef719ae service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:16.159881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-4d817dac-b460-40d3-a08a-0cfeb671e0c2 req-66ac0fe2-f682-4a11-ae86-91550ef719ae service nova] Creating event network-changed:6ca3af82-3d2d-4c59-b7dc-43cea11de78e for instance fda5e0fc-11d3-4bd6-ab13-5403531f371f on hv-cinder-84614 Jun 20 11:11:16.166590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-4d817dac-b460-40d3-a08a-0cfeb671e0c2 req-66ac0fe2-f682-4a11-ae86-91550ef719ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036432 Jun 20 11:11:16.167320 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 262/522] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:19.813098 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:19.814261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:19.816302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=46 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:19.821626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:19.822065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:19.823251 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:19.823737 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:19.849842 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:11:19.943183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0165e92e-d0b3-474e-961c-7ee9cafc0092 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 204 len: 0 microversion: 2.1 time: 0.134171 Jun 20 11:11:19.943746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 261/523] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:11:19 2022] DELETE /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:11:19.955216 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:19.963216 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:19.963216 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=44 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:19.965257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:19.965863 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:19.966812 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:19.967331 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:20.119496 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:20.127518 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e7c06702-9663-4519-8b8f-b8f386af9b5e tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1579 microversion: 2.1 time: 0.178932 Jun 20 11:11:20.128207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 263/524] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:19 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:21.146142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:21.146793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:21.154396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:21.154989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:21.156062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:21.156487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:21.161282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:21.304067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:21.312077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ac5f6928-b38b-4b03-b96e-66ce49587bd6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1579 microversion: 2.1 time: 0.170668 Jun 20 11:11:21.312662 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 262/525] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:21 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:22.330851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:22.332246 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:22.349187 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:22.350906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:22.351785 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:22.352232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:22.430033 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:22.442221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7776b76f-a3e6-416a-96d7-fb14a501b254 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1511 microversion: 2.1 time: 0.115334 Jun 20 11:11:22.442822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 264/526] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:22 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1511 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:22.596822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:11:22.597266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:11:22.653670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a8aeea2d-90a5-429c-a6e5-90e8bb051de4 req-1b315906-f4ed-4c20-a4a2-8fda68eb5583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93072671-19ba-4bf7-bfb9-c5d98181cd98", "name": "network-vif-deleted", "tag": "aed34f0b-54b2-4f4d-8270-55b349de05d7"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:22.675567 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a8aeea2d-90a5-429c-a6e5-90e8bb051de4 req-1b315906-f4ed-4c20-a4a2-8fda68eb5583 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:22.676065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a8aeea2d-90a5-429c-a6e5-90e8bb051de4 req-1b315906-f4ed-4c20-a4a2-8fda68eb5583 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:22.689460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a8aeea2d-90a5-429c-a6e5-90e8bb051de4 req-1b315906-f4ed-4c20-a4a2-8fda68eb5583 service nova] Creating event network-vif-deleted:aed34f0b-54b2-4f4d-8270-55b349de05d7 for instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 on hv-cinder-84614 Jun 20 11:11:22.695270 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a8aeea2d-90a5-429c-a6e5-90e8bb051de4 req-1b315906-f4ed-4c20-a4a2-8fda68eb5583 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047871 Jun 20 11:11:22.696075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 263/527] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:23.461377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:23.461996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:23.470014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:23.470659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:23.471391 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:23.471822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:23.506020 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:23.506779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:23.507233 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lazy-loading 'fault' on Instance uuid 93072671-19ba-4bf7-bfb9-c5d98181cd98 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:11:23.568635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:23.578472 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-212ca72e-b1e8-46ab-9c39-ff2daee8745f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 200 len: 1230 microversion: 2.1 time: 0.120722 Jun 20 11:11:23.579764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 265/528] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:23 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 1230 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:24.599910 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:24.601112 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:24.614059 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:24.614522 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:24.615345 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:24.615782 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:24.631336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] HTTP exception thrown: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Request method failure captured: Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 HTTP/1.1 Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFSqsR68xAXP_lxMAVD04KGHmmQ1P6NqlkGYTbzf7L4S_OBNx7_uXF5BFOoJZSREHszcBna6i9ENeAeuTI4Uq2NXZDJS9zyjjOdJvbsqfTP4EF3Y34QqBG5QqAcFuov30oKS7p2E7HuWAugOjNIDpvQRmT95cFV3G-8KqIcAM8NOMqU Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:11:24.633007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-66375657 Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: ee21ef9eacd24177a852f28d17376191 Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:11:24.634396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '93072671-19ba-4bf7-bfb9-c5d98181cd98'} Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:11:24.635187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:11:24.636392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:11:24.637571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Returning 404 to user: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:11:24.637571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0024debf-56fc-4bae-bf27-8cafff3c334c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 404 len: 111 microversion: 2.1 time: 0.040562 Jun 20 11:11:24.637571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 264/529] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:24 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:11:24.687675 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1755090236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1558821828", "security_groups": [{"name": "tempest-secgroup-smoke-1979074994"}], "block_device_mapping_v2": [{"uuid": "11a3624a-f163-40c6-871d-3b7221802b1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7129602-ccc0-484b-85f3-177744b5235e"}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:24.816406 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] validate_networks() for [('f7129602-ccc0-484b-85f3-177744b5235e', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:11:25.251338 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:11:25.252127 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:11:25.252596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:11:25.253108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:11:25.253551 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:11:25.263115 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:25.263557 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:25.264326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:25.264757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:25.282120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for project 17bb5c3721fc4505a51879dae4762b43. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:11:25.286867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for user ee21ef9eacd24177a852f28d17376191 and project 17bb5c3721fc4505a51879dae4762b43. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:11:25.352787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:11:25.354854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11a3624a-f163-40c6-871d-3b7221802b1a',volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:11:25.486917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8387d657-0d9a-4040-a4f3-2b58210df191 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.803183 Jun 20 11:11:25.487711 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 266/530] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:11:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:11:25.497916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c5d08dd-d5cc-40a6-bf57-47e6c75b25ee tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:25.498575 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8c5d08dd-d5cc-40a6-bf57-47e6c75b25ee tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:25.556452 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8c5d08dd-d5cc-40a6-bf57-47e6c75b25ee tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:25.563634 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c5d08dd-d5cc-40a6-bf57-47e6c75b25ee tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1095 microversion: 2.1 time: 0.069243 Jun 20 11:11:25.564237 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 265/531] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:25 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:26.581804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:26.582413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:26.589788 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:26.590271 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:26.591040 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:26.591479 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:26.659732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:26.668035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b19bdf26-64ab-47be-9b26-90ac1f44b444 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1211 microversion: 2.1 time: 0.090949 Jun 20 11:11:26.677741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 267/532] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:26 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:27.685785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:27.686381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:27.694787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:27.695253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:27.696036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:27.696465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:28.187048 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:28.196497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdfcd402-24a0-4288-9091-90e0d9e57b6a tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.514003 Jun 20 11:11:28.206854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 266/533] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:27 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:28.345582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-b8c199c5-b514-4f09-a08a-0e360fa2c0a5 req-17c83d2a-cbd0-4432-8a47-25de25dc2628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0bd9d86-9ab6-41fe-91a0-56a60a049a10", "tag": "c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:28.354558 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-b8c199c5-b514-4f09-a08a-0e360fa2c0a5 req-17c83d2a-cbd0-4432-8a47-25de25dc2628 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:28.355258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-b8c199c5-b514-4f09-a08a-0e360fa2c0a5 req-17c83d2a-cbd0-4432-8a47-25de25dc2628 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:28.375297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-b8c199c5-b514-4f09-a08a-0e360fa2c0a5 req-17c83d2a-cbd0-4432-8a47-25de25dc2628 service nova] Creating event network-changed:c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1 for instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 on hv-cinder-84614 Jun 20 11:11:28.381705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-b8c199c5-b514-4f09-a08a-0e360fa2c0a5 req-17c83d2a-cbd0-4432-8a47-25de25dc2628 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040913 Jun 20 11:11:28.385389 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 268/534] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:29.214654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:29.215242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:29.221822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:29.222301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:29.223090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:29.223524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:29.362231 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:29.370466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f0f759a5-6ef4-45cf-863c-20af671d67c6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.159803 Jun 20 11:11:29.371050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 267/535] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:29 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:30.388729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:30.389398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:30.397613 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:30.398058 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:30.398852 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:30.399279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:30.402145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=91 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:30.543787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:30.553673 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-01aab533-b7ae-4424-bd43-c8a38e7c6c05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.169585 Jun 20 11:11:30.554308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 269/536] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:30 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:31.573083 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:31.573658 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:31.580815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:31.581238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:31.581998 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:31.582456 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:31.729990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:31.738310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f1797f8a-91fe-45bb-9467-0625ad92fbad tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.169041 Jun 20 11:11:31.738989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 268/537] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:31 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:32.756345 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:32.756928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:32.763686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:32.764130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:32.764881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:32.765308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:32.904513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:32.912691 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f8eccbe4-9523-4200-9581-bfe779ca628c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.160259 Jun 20 11:11:32.913264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 270/538] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:32 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:33.929532 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:33.930208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:33.939856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:33.940308 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:33.941097 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:33.941758 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:34.096361 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:34.104598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7145c659-c677-4518-991d-b0c279b3052f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.179071 Jun 20 11:11:34.105197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 269/539] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:33 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:35.121105 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:35.121753 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:35.129308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:35.129776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:35.130703 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:35.131130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:35.268135 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:35.273952 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:35.276622 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-12fcdf1d-20a9-456f-8170-5fdb58d25117 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.159493 Jun 20 11:11:35.277198 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 271/540] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:35 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:36.293093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:36.293728 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:36.295776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:36.301642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:36.302113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:36.302889 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:36.303322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:36.440156 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:36.448025 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b583abf-10c7-4023-ac2f-7e16d2354ec7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.158858 Jun 20 11:11:36.448591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 270/541] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:36 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:37.465610 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:37.466257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:37.468056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:37.474592 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:37.475032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:37.475792 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:37.476219 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:37.614940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:37.622390 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-34ae2785-b2ae-43ed-b879-eb98ef64b960 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.161040 Jun 20 11:11:37.622957 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 272/542] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:37 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:38.640045 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:38.640668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:38.647728 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:38.648173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:38.648932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:38.649361 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:38.790230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:38.798240 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13fb643d-f427-45ed-8769-abb0fd8e432f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.162043 Jun 20 11:11:38.798962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 271/543] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:38 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:39.816684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:39.817287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:39.824332 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:39.824783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:39.825553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:39.825988 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:39.963729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:39.971600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d66d364c-6b23-41b1-8d8b-c37eb23f8581 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.159781 Jun 20 11:11:39.972166 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 273/544] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:39 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:40.988814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:40.989379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:40.996003 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:40.996443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:40.997206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:40.997663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:41.131979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:41.139667 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fc4402a9-d123-422a-8947-8e21e448b5c7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.154782 Jun 20 11:11:41.140222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 272/545] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:40 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:41.610695 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a486d16a-9ecd-46d3-b5c1-722231ab4adb req-5a4f45be-408b-4e1a-a9e0-53036c95c866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0bd9d86-9ab6-41fe-91a0-56a60a049a10", "name": "network-vif-plugged", "status": "completed", "tag": "c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:41.619940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a486d16a-9ecd-46d3-b5c1-722231ab4adb req-5a4f45be-408b-4e1a-a9e0-53036c95c866 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:41.620374 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a486d16a-9ecd-46d3-b5c1-722231ab4adb req-5a4f45be-408b-4e1a-a9e0-53036c95c866 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:41.633171 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a486d16a-9ecd-46d3-b5c1-722231ab4adb req-5a4f45be-408b-4e1a-a9e0-53036c95c866 service nova] Creating event network-vif-plugged:c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1 for instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 on hv-cinder-84614 Jun 20 11:11:41.638562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a486d16a-9ecd-46d3-b5c1-722231ab4adb req-5a4f45be-408b-4e1a-a9e0-53036c95c866 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Jun 20 11:11:41.639352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 274/546] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:42.157132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:42.158001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:42.164213 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:42.164685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:42.165441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:42.165885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:42.309541 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:42.318119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6cc990e-25c2-45e4-8641-1c5c111e00aa tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.164929 Jun 20 11:11:42.318713 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 273/547] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:42 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:43.336602 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:43.337246 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:43.344850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:43.345007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:43.345850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:43.346314 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:43.489715 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:43.497471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-986cddbf-937e-4584-b7d9-4313d150f5f6 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1267 microversion: 2.1 time: 0.165625 Jun 20 11:11:43.498075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 275/548] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:43 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:44.513820 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:44.514458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:44.522670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:44.523146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:44.523927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:44.524369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:44.665619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:44.673715 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd481586-0506-481d-9efe-6ed366f13a8c tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1455 microversion: 2.1 time: 0.163747 Jun 20 11:11:44.674476 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 274/549] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:44 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:44.690988 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:44.691674 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:44.698491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:44.698930 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:44.699698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:44.700135 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:44.836785 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:44.844958 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-90bdb663-703e-42d5-9813-dc5b133b7abf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1455 microversion: 2.1 time: 0.158586 Jun 20 11:11:44.845533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 276/550] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:44 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:46.891353 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-752c95c8-523f-4030-ab39-8bf26e07ccea req-7a32e1a8-fae1-4aad-b8f5-c075c381039c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0bd9d86-9ab6-41fe-91a0-56a60a049a10", "tag": "c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:46.899835 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-752c95c8-523f-4030-ab39-8bf26e07ccea req-7a32e1a8-fae1-4aad-b8f5-c075c381039c service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:46.900261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-752c95c8-523f-4030-ab39-8bf26e07ccea req-7a32e1a8-fae1-4aad-b8f5-c075c381039c service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:46.912982 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-752c95c8-523f-4030-ab39-8bf26e07ccea req-7a32e1a8-fae1-4aad-b8f5-c075c381039c service nova] Creating event network-changed:c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1 for instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 on hv-cinder-84614 Jun 20 11:11:46.918285 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-752c95c8-523f-4030-ab39-8bf26e07ccea req-7a32e1a8-fae1-4aad-b8f5-c075c381039c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030574 Jun 20 11:11:46.918938 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 275/551] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:11:48.099718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:11:48.100285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:48.106880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:48.107458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:48.108239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:48.108675 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:48.135629 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lazy-loading 'flavor' on Instance uuid f32e69e7-1865-492a-8571-a7f975792a16 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:11:48.259292 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8043f5ac-fc05-49a3-9ddf-70ff918523b0 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "POST /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16/action" status: 202 len: 0 microversion: 2.1 time: 0.163373 Jun 20 11:11:48.259848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 277/552] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:11:48 2022] POST /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:11:48.270374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:48.271100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:48.278961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:48.279544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:48.280557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:48.281074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:48.438035 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:48.445913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aa091ab3-7180-4e7b-b3ef-45b3712318bd tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.180215 Jun 20 11:11:48.446549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 276/553] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:48 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:11:49.467958 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:49.468704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:49.476134 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:49.476507 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:49.477420 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:49.477977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:49.632522 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:49.640642 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e17bdd56-c30e-42aa-8fd5-7415b6f4cbb9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.179953 Jun 20 11:11:49.641295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 278/554] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:49 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:50.660574 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:50.661220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:50.664007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:50.671915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:50.672427 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:50.673408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:50.673849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:50.840080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:50.850926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-af0a89cb-2b81-4a59-9eb8-b8c9e5d1f2c7 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.193918 Jun 20 11:11:50.851255 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 277/555] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:50 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:51.871893 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:51.872538 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:51.875459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:51.880945 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:51.881383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:51.882238 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:51.882641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:52.032435 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:52.041100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-284869eb-6024-426d-a38d-317637e20ff5 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.175040 Jun 20 11:11:52.041693 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 279/556] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:51 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:53.059204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:53.059820 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:53.066882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:53.067326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:53.068273 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:53.068711 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:53.071827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=77 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:11:53.218592 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:53.227340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7248d00-f540-462e-a4b0-8f83cbdecc84 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.172069 Jun 20 11:11:53.227916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 278/557] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:53 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:54.249136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:54.250034 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:54.258804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:54.259331 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:54.260466 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:54.261026 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:54.434141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:54.444544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f7bdb277-8957-48c6-9f04-55820b606881 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.202257 Jun 20 11:11:54.445212 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 280/558] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:54 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:55.465717 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:55.466374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:55.473748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:55.474214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:55.475124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:55.475590 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:55.627060 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:55.640623 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-21523d07-47e3-4127-95fe-8f80418628ba tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.180682 Jun 20 11:11:55.641666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 279/559] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:55 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:56.662277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:56.662891 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:56.671607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:56.672342 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:56.673595 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:56.674184 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:56.837239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:56.847531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7823b230-3059-45b6-a36b-e4dc62d026e9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.189422 Jun 20 11:11:56.848370 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 281/560] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:56 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:57.869075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:57.869748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:57.876205 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:57.876648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:57.877503 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:57.877931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:58.042368 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:58.050311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b2b8738d-405e-4752-bb36-485123660f56 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.185359 Jun 20 11:11:58.050884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 280/561] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:57 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:11:59.070523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:11:59.071141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:11:59.080690 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:59.081960 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:59.082802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:11:59.083240 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:11:59.238329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:11:59.250844 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dcc89447-55e1-4bf8-a581-5e4dcbc8ba61 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.185498 Jun 20 11:11:59.251453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 282/562] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:11:59 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:00.269272 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:00.270032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:00.278462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:00.279064 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:00.279918 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:00.280447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:00.442440 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:00.450933 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-75c6258c-a47a-450b-a1c4-7aeaf86f0d6b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.185760 Jun 20 11:12:00.451578 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 281/563] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:00 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:01.469136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:01.469740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:01.477008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:01.477464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:01.478272 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:01.478685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:01.481325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:01.626763 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:01.635481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3014b544-50f9-4cff-b887-4c86c1ef437d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.170230 Jun 20 11:12:01.636078 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 283/564] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:01 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:02.655878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:02.656486 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:02.665571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:02.666018 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:02.666808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:02.667235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:02.809757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:02.821466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ac9a3ce-abc0-4911-8309-2944da818a06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.171506 Jun 20 11:12:02.822162 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 282/565] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:02 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:03.844358 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:03.844976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:03.851553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:03.851994 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:03.852841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:03.853277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:03.990385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:03.998879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4cfc17d0-bd46-4961-9df6-d27800f719c1 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.159061 Jun 20 11:12:03.999501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 284/566] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:03 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:05.016303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:05.016913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:05.023770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.024222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.024996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.025437 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.168908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:05.176877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d8bc671-8f78-46a0-b636-1768857688db tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.164556 Jun 20 11:12:05.177448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 283/567] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:05 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:05.522247 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:05.523185 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:05.530509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.530956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.531725 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.532180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.565484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a0bd5b2a-04b5-4841-b78a-8dbc92fc8d29 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047281 Jun 20 11:12:05.566036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 285/568] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:12:05 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:12:05.628261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:05.628785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:05.635378 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.635829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.636593 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.637030 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.661885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:12:05.740121 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-41bd58f3-fe70-4dca-8f7b-af5087cd15ba tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 204 len: 0 microversion: 2.1 time: 0.115423 Jun 20 11:12:05.740622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 284/569] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:12:05 2022] DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:12:05.749237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:05.749607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:05.756217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.756671 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.757434 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:05.758454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:05.898683 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:05.906717 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b11a77d4-32e9-46cc-90b9-c4b4275cc021 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1673 microversion: 2.1 time: 0.161534 Jun 20 11:12:05.907290 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 286/570] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:05 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:06.195347 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:06.196073 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:06.202834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:06.203281 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:06.204031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:06.204466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:06.339684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:06.347407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9cd286ed-5a51-42cd-8cec-279093a11950 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.156560 Jun 20 11:12:06.347969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 285/571] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:06 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:06.924769 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:06.925383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:06.933067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:06.933621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:06.934526 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:06.935143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:07.075561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:07.083213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-293faeb7-0f58-4110-8a7c-fbd9edcda62d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1673 microversion: 2.1 time: 0.162704 Jun 20 11:12:07.083776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 287/572] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:06 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:07.364965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:07.365583 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:07.372642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:07.373075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:07.373846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:07.374317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:07.588227 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:07.596284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cb0a2732-4860-460d-bc59-7a8c6465b920 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1568 microversion: 2.1 time: 0.235165 Jun 20 11:12:07.596972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 286/573] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:07 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:07.613335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:07.613947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:07.620872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:07.621308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:07.622103 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:07.622571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:07.718459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0b1e78b9-c16a-4cb0-b125-972f0d0a09c9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "POST /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16/action" status: 202 len: 0 microversion: 2.1 time: 0.109176 Jun 20 11:12:07.722583 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 288/574] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:12:07 2022] POST /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:12:07.727610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:07.728462 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:07.734619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:07.735061 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:07.735828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:07.736253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:08.000996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:08.008854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a2a69f5-40d4-413f-9c86-4d5b386f79f2 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1516 microversion: 2.1 time: 0.285092 Jun 20 11:12:08.009590 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 287/575] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:07 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1516 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:08.101535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:08.102978 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:08.111825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:08.112378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:08.113185 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:08.113704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:08.190292 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:08.200980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-697b2ed8-5dcc-48e1-9be9-d144de9e0627 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1605 microversion: 2.1 time: 0.104401 Jun 20 11:12:08.202176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 289/576] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:08 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:08.749492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-179e375b-ec95-4d35-85e6-1fadb82a1975 req-cb0bcf97-2c5e-4bf8-8fad-dec1d0cb1da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe316d92-1158-4b44-b5c6-1c7c37e4c10d", "name": "network-vif-deleted", "tag": "6416c894-1760-4713-ad6f-e0a40d7e0789"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:08.758878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-179e375b-ec95-4d35-85e6-1fadb82a1975 req-cb0bcf97-2c5e-4bf8-8fad-dec1d0cb1da4 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:08.759763 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-179e375b-ec95-4d35-85e6-1fadb82a1975 req-cb0bcf97-2c5e-4bf8-8fad-dec1d0cb1da4 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:08.771842 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-179e375b-ec95-4d35-85e6-1fadb82a1975 req-cb0bcf97-2c5e-4bf8-8fad-dec1d0cb1da4 service nova] Creating event network-vif-deleted:6416c894-1760-4713-ad6f-e0a40d7e0789 for instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d on hv-cinder-84614 Jun 20 11:12:08.780639 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-179e375b-ec95-4d35-85e6-1fadb82a1975 req-cb0bcf97-2c5e-4bf8-8fad-dec1d0cb1da4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Jun 20 11:12:08.781341 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 288/577] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:09.026395 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:09.026996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:09.033150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:09.033619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:09.034438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:09.036158 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:09.182866 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:09.192305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6041c76b-c9ef-42d6-a2e4-d69307b77918 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1518 microversion: 2.1 time: 0.169776 Jun 20 11:12:09.192872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 290/578] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:09 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:09.219677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:09.220677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:09.236624 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:09.239702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:09.241212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:09.241966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:09.288853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:09.289586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:09.290308 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lazy-loading 'fault' on Instance uuid fe316d92-1158-4b44-b5c6-1c7c37e4c10d {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:12:09.343289 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:09.351535 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cc147b26-5882-490d-a68f-26c76cae0d9a tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 200 len: 1326 microversion: 2.1 time: 0.136320 Jun 20 11:12:09.362895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 289/579] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:09 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 1326 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:09.673851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-ab77a037-c6d7-4717-b8db-5311a8ce8c62 req-dc1a7f22-b792-48b1-b2d1-7109152189dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "name": "network-vif-unplugged", "status": "completed", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:09.684361 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ab77a037-c6d7-4717-b8db-5311a8ce8c62 req-dc1a7f22-b792-48b1-b2d1-7109152189dc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:09.684803 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ab77a037-c6d7-4717-b8db-5311a8ce8c62 req-dc1a7f22-b792-48b1-b2d1-7109152189dc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:09.697854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-ab77a037-c6d7-4717-b8db-5311a8ce8c62 req-dc1a7f22-b792-48b1-b2d1-7109152189dc service nova] Creating event network-vif-unplugged:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:12:09.703481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-ab77a037-c6d7-4717-b8db-5311a8ce8c62 req-dc1a7f22-b792-48b1-b2d1-7109152189dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034072 Jun 20 11:12:09.704275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 291/580] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:10.210697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:10.211997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:10.218512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.218962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.219743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.220175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.371653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:10.372228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:10.379190 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.379631 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.380415 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.380855 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.395001 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] HTTP exception thrown: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Request method failure captured: Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d HTTP/1.1 Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ9MAV1ZUI9p1JtoWUQkhTS_yo16_GshqC2QGYCjkzRxl1MzVmBMNgXTsURvIo0a0xmWX4P98yQqVHqRgJszQSHAXQtd8NR9keAbDkbl77U3upnU7GXPgYONNLtNwLOkDpumFTHJmExOEP8gvYQdMFxejq-Up4hSq2fsjT2iKdGq5M Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:12:10.396666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 48e77af2b3a2409fa6d352b0d2674b85 Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:12:10.398223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'fe316d92-1158-4b44-b5c6-1c7c37e4c10d'} Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:12:10.399307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:12:10.401173 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:10.403125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Returning 404 to user: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:12:10.403125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-42b435a7-19da-405e-aa27-663d5bb97eda tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 404 len: 111 microversion: 2.1 time: 0.031555 Jun 20 11:12:10.403125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 292/581] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:10 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:12:10.407537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:10.408501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:10.414660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.415124 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.415904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.416339 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.430471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:10.441271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36e064e2-5c6e-4c76-984e-9b5c763bf98f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.234416 Jun 20 11:12:10.442015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 290/582] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:10 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:10.449381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e398c5d-a5c2-4ff0-adea-ec84c0534415 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '.version_select at 0x7f7215b00f70>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:10.477197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e398c5d-a5c2-4ff0-adea-ec84c0534415 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93270669" status: 202 len: 0 microversion: 2.1 time: 0.031009 Jun 20 11:12:10.478449 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 291/583] 10.222.0.33 () {58 vars in 1214 bytes} [Mon Jun 20 11:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93270669 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:12:10.500373 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3b329ad0-33f8-44d3-b3fb-ed062a8c8f2b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/action" status: 202 len: 0 microversion: 2.1 time: 0.096375 Jun 20 11:12:10.501024 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 293/584] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:12:10 2022] POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:12:10.509399 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:10.510268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:10.517679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.518264 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.519118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:10.519659 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:10.714038 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:10.722965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0acc507d-de39-4da8-b535-74bcb55f282b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1747 microversion: 2.1 time: 0.217628 Jun 20 11:12:10.724204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 292/585] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:10 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1747 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:11.166137 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a259b833-bb00-4059-9e77-3de4a3d2266d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: .version_select at 0x7f721506fee0>, body: {"keypair": {"name": "tempest-keypair-1555853467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiZzyQymE3MXv3hIGvNlWN0rsboEe+l2sVKRf46XJbHRczXW5wj8Z3FsCobcZE5srPqWoXAJCQAkRTBTAGaPhoR5WurNZGKqM51XXZEM8lHzDkGhr40Dp9CvEZaXa3t9g=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:11.181835 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-a259b833-bb00-4059-9e77-3de4a3d2266d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:12:11.186411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-a259b833-bb00-4059-9e77-3de4a3d2266d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for user 48e77af2b3a2409fa6d352b0d2674b85 and project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:12:11.212074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a259b833-bb00-4059-9e77-3de4a3d2266d tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050381 Jun 20 11:12:11.212878 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 294/586] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:12:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:11.460327 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:11.460976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:11.469838 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:11.473441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:11.474527 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:11.475248 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:11.742474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:11.744202 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:11.745005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:11.752971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-95646df2-cb46-4117-959d-3aa53fee0b8f tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.296697 Jun 20 11:12:11.753847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:11.754452 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:11.755706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:11.756149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:11.763271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 293/587] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:11 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:12.021263 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:12.030637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b7818f09-df65-47f0-9382-fb94070a7369 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1747 microversion: 2.1 time: 0.291841 Jun 20 11:12:12.031376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 295/588] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:11 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1747 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:12:12.696908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-50500872", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2838ade6-e0cf-48ef-bf2a-3dd3bebd20c7"}], "security_groups": [{"name": "tempest-securitygroup--916429480"}], "key_name": "tempest-keypair-1555853467", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:12.770729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:12.771320 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:12.778537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:12.778980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:12.779735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:12.780157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:12.799505 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] validate_networks() for [('2838ade6-e0cf-48ef-bf2a-3dd3bebd20c7', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:12:12.916810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:12.924683 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-115d27ce-93ad-4d04-8461-714818e29292 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.157844 Jun 20 11:12:12.925413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 296/589] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:12 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:13.048458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:13.048967 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:13.055730 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:13.056157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:13.056942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:13.057365 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:13.183322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:12:13.183807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:12:13.184270 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:12:13.184674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:12:13.185247 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:12:13.194831 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:13.195425 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:13.196259 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:13.196696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:13.199833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:13.208059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-32d9fc87-0448-4254-a85f-4d4cb62e17bb tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.163659 Jun 20 11:12:13.208637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 297/590] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:13 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:13.214804 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:12:13.219158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Getting quotas for user 48e77af2b3a2409fa6d352b0d2674b85 and project 7eb9dd7f67cb48cebba2dabcd32a21d7. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:12:13.230675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:12:13.232942 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:12:13.281784 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-387daefc-83fd-4f61-b33e-e6399c8c6c03 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589134 Jun 20 11:12:13.282766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 294/591] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:12:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:12:13.296126 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-069d3113-95a5-4a12-8ca2-62af5ded7f16 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:13.296745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-069d3113-95a5-4a12-8ca2-62af5ded7f16 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:13.359581 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-069d3113-95a5-4a12-8ca2-62af5ded7f16 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:13.366867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-069d3113-95a5-4a12-8ca2-62af5ded7f16 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1236 microversion: 2.1 time: 0.078158 Jun 20 11:12:13.367416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 298/592] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:13 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:13.942699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:13.943268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:13.949918 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:13.950397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:13.951151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:13.951591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:13.954227 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:14.085687 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:14.093555 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d76d5de8-3d9b-4caf-b23e-7bcedcdac67b tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.154808 Jun 20 11:12:14.094127 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 295/593] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:13 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:14.226372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:14.227217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:14.235320 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:14.235866 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:14.236711 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:14.237212 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:14.384934 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:14.385971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:14.392428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:14.393204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:14.394206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:14.394827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:14.404491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:14.413933 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-49603f95-c504-418a-aaf7-aaaebe582989 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.191525 Jun 20 11:12:14.415403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 299/594] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:14 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:14.503125 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:14.511313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fd74e5df-c7a3-479d-b7dd-25d176ef34ff tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1294 microversion: 2.1 time: 0.130674 Jun 20 11:12:14.511867 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 296/595] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:14 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1294 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:15.111277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:15.111794 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:15.118431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.118866 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.119724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.120170 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.258133 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:15.265858 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2098b5ca-b808-4c2d-b77c-a3e80fa73b96 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.158535 Jun 20 11:12:15.266461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 300/596] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:15 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:15.433015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:15.433729 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:15.441313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.441921 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.442808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.443321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.529817 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:15.530626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:15.537761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.538376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.539670 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.540976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.544416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:15.676334 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:15.695424 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bcb23a85-910a-443e-a65e-5136fa89453e tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.267031 Jun 20 11:12:15.698495 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 297/597] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:15 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:15.704794 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:15.713355 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9dda3e4c-90e7-453d-aedc-c053cafde61c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.187767 Jun 20 11:12:15.713946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 301/598] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:15 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:12:15.809265 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-f3ab251f-6648-4bca-9e16-6d6365f6b2ef req-e15a001a-e3f3-4468-9573-ec849cf9b7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a57fac4-93ed-4e53-b5b3-d18a1834707b", "tag": "85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:15.823906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f3ab251f-6648-4bca-9e16-6d6365f6b2ef req-e15a001a-e3f3-4468-9573-ec849cf9b7c0 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:15.824705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-f3ab251f-6648-4bca-9e16-6d6365f6b2ef req-e15a001a-e3f3-4468-9573-ec849cf9b7c0 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:15.839118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-f3ab251f-6648-4bca-9e16-6d6365f6b2ef req-e15a001a-e3f3-4468-9573-ec849cf9b7c0 service nova] Creating event network-changed:85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5 for instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b on hv-cinder-84614 Jun 20 11:12:15.847954 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-f3ab251f-6648-4bca-9e16-6d6365f6b2ef req-e15a001a-e3f3-4468-9573-ec849cf9b7c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042372 Jun 20 11:12:15.849109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 298/599] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:16.283781 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:16.284374 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:16.291720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:16.292177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:16.292937 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:16.293370 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:16.431872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:16.440161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-68048e7b-16d1-4ba6-9e29-d9aaff22874a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.160322 Jun 20 11:12:16.440748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 302/600] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:16 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:16.713417 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:16.714036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:16.721147 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:16.721586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:16.722385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:16.722813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:16.730616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:16.731256 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:16.738056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:16.738545 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:16.739312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:16.739752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:16.870725 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:16.873530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:16.879077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a8c8d58c-d6b3-470d-b9c1-101add253e4c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.170063 Jun 20 11:12:16.879661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 299/601] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:16 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:16.881270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a0ec9ad4-586b-422c-9cdf-91fa831dd5b1 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.154877 Jun 20 11:12:16.881906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 303/602] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:16 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:12:17.457552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:17.458184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:17.465328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:17.465772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:17.466558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:17.466979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:17.603898 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:17.612020 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-68f41a39-fb83-4ca3-86f1-0d2370b6bf28 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.158356 Jun 20 11:12:17.612598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 300/603] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:17 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:17.897366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:17.897946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:17.897946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:17.898449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:17.905065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:17.905301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:17.905515 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:17.905639 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:17.906324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:17.906442 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:17.906752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:17.906869 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:18.041540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:18.049362 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4645f538-4900-4a11-83eb-d83a44bb7c28 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.155773 Jun 20 11:12:18.049939 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 301/604] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:17 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:18.056402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:18.065128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c57f4055-a631-49e5-9506-432f71c0db4a tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.171682 Jun 20 11:12:18.065705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 304/605] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:17 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:18.629164 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:18.629803 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:18.636439 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:18.636885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:18.637645 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:18.638077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:18.771306 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:18.779660 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ae6b8ffc-04ad-40f5-80ad-ad4232cb1aa9 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.154387 Jun 20 11:12:18.780226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 302/606] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:18 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:19.066906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:19.067487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:19.075087 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:19.075539 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:19.076329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:19.076770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:19.082459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:19.083095 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:19.089812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:19.090284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:19.091111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:19.091594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:19.208779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:19.217857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d305e8e0-046f-44f2-96ad-a5f0ee1216ca tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.155324 Jun 20 11:12:19.218622 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 305/607] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:19 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:19.241872 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:19.250601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c01757f8-7e40-46f8-bcca-fc24b775ba83 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.172050 Jun 20 11:12:19.251186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 303/608] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:19 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:19.797685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:19.798349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:19.804903 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:19.805464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:19.806468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:19.806899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:19.944764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:19.953710 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-67798e7c-5a68-4508-9244-edc325046897 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.159919 Jun 20 11:12:19.954214 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 306/609] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:19 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:20.236753 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:20.237212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:20.245520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.246322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.247279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.247907 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.270419 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:20.271955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:20.282078 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.282564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.283336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.284396 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.453645 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:20.463076 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-56fa2fce-22cc-4ab4-b6f7-101c59e95a8b tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.197989 Jun 20 11:12:20.472657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 307/610] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:20 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:20.478453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:20.479019 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:20.479348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:20.485889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.486709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.487117 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-724ff68e-325d-4058-8a77-3d51f5327df6 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.255396 Jun 20 11:12:20.487801 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.488459 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.498008 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 304/611] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:20 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:20.584607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lazy-loading 'services' on Instance uuid fda5e0fc-11d3-4bd6-ab13-5403531f371f {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:12:20.660655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-50fcea94-be1e-481b-9157-7060d864e4f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments/115ac765-06e9-4649-b9e9-f1e80e89fcbe" status: 202 len: 0 microversion: 2.1 time: 0.186602 Jun 20 11:12:20.661405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 308/612] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:12:20 2022] DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments/115ac765-06e9-4649-b9e9-f1e80e89fcbe => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:12:20.669950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:20.670993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:20.677879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.678452 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.679485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.680145 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.720981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a3430d0-c0e7-4959-8b62-b803935ba9f6 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055004 Jun 20 11:12:20.721623 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 305/613] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:12:20 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:20.971704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:20.972402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:20.979449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.979937 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:20.980735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:20.981240 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.116989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:21.124879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bcb1a052-0181-47b1-9009-3e79ff37fdf6 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.157419 Jun 20 11:12:21.125445 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 309/614] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:20 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:21.482445 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:21.483430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:21.486390 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:21.495430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.496147 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.499238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.499238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.505285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:21.506880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:21.516418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.516840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.517743 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.518880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.674997 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:21.681292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:21.685230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-553239ec-e6e0-4577-ab89-34105513c273 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.184595 Jun 20 11:12:21.686029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 310/615] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:21 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:21.693994 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b8f00d2-2dd0-4252-8cdd-eb2327cb2487 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.217332 Jun 20 11:12:21.694596 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 306/616] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:21 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:21.733273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:21.734302 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:21.740836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.741315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.742108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.742896 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.775868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f3fc7ea1-88ff-4531-8da7-f0294cdc0212 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046572 Jun 20 11:12:21.776444 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 311/617] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:12:21 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:12:21.853433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:21.853849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:21.861738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.862233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.863009 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.863438 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.889175 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-e93ee253-896e-43bb-9da4-6b902099fdd1 req-0df53fa7-ff2d-4fa1-bb58-6f553050df2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "name": "network-vif-plugged", "status": "completed", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:21.889812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:12:21.893981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:21.898594 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e93ee253-896e-43bb-9da4-6b902099fdd1 req-0df53fa7-ff2d-4fa1-bb58-6f553050df2d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:21.899873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e93ee253-896e-43bb-9da4-6b902099fdd1 req-0df53fa7-ff2d-4fa1-bb58-6f553050df2d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:21.913425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-e93ee253-896e-43bb-9da4-6b902099fdd1 req-0df53fa7-ff2d-4fa1-bb58-6f553050df2d service nova] Creating event network-vif-plugged:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:12:21.923435 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-e93ee253-896e-43bb-9da4-6b902099fdd1 req-0df53fa7-ff2d-4fa1-bb58-6f553050df2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037776 Jun 20 11:12:21.924376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 312/618] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:21.982769 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1f4383e3-8210-4820-a7a0-ab207afdeb2a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 204 len: 0 microversion: 2.1 time: 0.132683 Jun 20 11:12:21.983380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 307/619] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:12:21 2022] DELETE /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:12:21.993471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:21.994203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:22.000737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.001175 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.002044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.002503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.142702 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:22.143318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:22.144028 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:22.150354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.150803 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.151290 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d8b927a5-34c6-40c4-9b66-91c6381eec20 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1689 microversion: 2.1 time: 0.163466 Jun 20 11:12:22.151571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.151898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 313/620] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:21 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:22.153836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.287472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:22.295686 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-abbe7fba-a3c9-401a-b1d0-4a885da6ee3c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.156697 Jun 20 11:12:22.296263 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 308/621] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:22 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:12:22.704155 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:22.704753 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:22.711842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.712268 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.713046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:22.713500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.713500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.713696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:22.720135 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.720578 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.721346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:22.721776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:22.858067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:22.865870 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0e6e8e0e-bb3c-43f3-9a00-8eadcdf60fe4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.165568 Jun 20 11:12:22.866490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 314/622] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:22 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:22.887487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:22.896597 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4824c55f-4602-4680-98dc-7b251e5f7062 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.188124 Jun 20 11:12:22.897201 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 309/623] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:22 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:23.169656 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:23.170147 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:23.176904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.177351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.178136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.178673 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.314044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:23.314697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:23.318177 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:23.318666 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:23.319182 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:23.326148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.326593 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.327360 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.327680 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5d1dce08-9a2e-4b8e-921b-c679e407fb94 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1689 microversion: 2.1 time: 0.162346 Jun 20 11:12:23.327803 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.328504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 315/624] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:23 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:23.505900 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:23.508369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:23.515648 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a305328-dec1-4583-9618-d3818efd52b4 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.205951 Jun 20 11:12:23.516402 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 310/625] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:23 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:23.882723 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:23.883986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:23.886069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:23.892723 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.893165 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.893935 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.894385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.920217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:23.920217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:23.922685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.923142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:23.923921 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:23.925054 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:24.061668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:24.070377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e4fea969-28a6-440a-9997-16ac926798a3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.191355 Jun 20 11:12:24.071209 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 316/626] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:23 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:24.076109 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-82709ca2-01f1-4ac3-803c-4188c109a36d req-1cd14bde-aebb-43e4-be0f-d6c426690da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a57fac4-93ed-4e53-b5b3-d18a1834707b", "name": "network-vif-plugged", "status": "completed", "tag": "85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:24.081100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:24.084783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-82709ca2-01f1-4ac3-803c-4188c109a36d req-1cd14bde-aebb-43e4-be0f-d6c426690da5 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:24.085228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-82709ca2-01f1-4ac3-803c-4188c109a36d req-1cd14bde-aebb-43e4-be0f-d6c426690da5 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:24.090269 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4b7125cf-29e6-4e24-a223-1d573f3da48d tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.180431 Jun 20 11:12:24.090884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 311/627] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:23 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:24.097729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-82709ca2-01f1-4ac3-803c-4188c109a36d req-1cd14bde-aebb-43e4-be0f-d6c426690da5 service nova] Creating event network-vif-plugged:85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5 for instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b on hv-cinder-84614 Jun 20 11:12:24.103247 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-82709ca2-01f1-4ac3-803c-4188c109a36d req-1cd14bde-aebb-43e4-be0f-d6c426690da5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030529 Jun 20 11:12:24.103886 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 317/628] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:24.346142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:24.346790 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:24.353870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:24.354355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:24.355130 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:24.355561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:24.494892 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:24.503637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d829632c-a07e-4003-af24-fde343739537 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1689 microversion: 2.1 time: 0.161532 Jun 20 11:12:24.504217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 312/629] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:24 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:24.537061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:24.537769 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:24.544556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:24.545009 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:24.545771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:24.546235 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:24.562757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:24.683161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:24.691484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0e4f5816-b9ab-4fc3-b746-84b0eb23c254 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.161013 Jun 20 11:12:24.692028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 318/630] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:24 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:25.088740 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:25.089425 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:25.096220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.096776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.097600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.098055 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.108467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:25.109119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:25.116176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.116605 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.117540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.118466 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.288678 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:25.297780 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e6c1e2c1-26c4-4f28-8183-529e831cde26 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1752 microversion: 2.1 time: 0.193283 Jun 20 11:12:25.298412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 319/631] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:25 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:25.335644 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:25.345791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8085797a-0ee2-4937-8e2a-60e794a95ef4 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.261364 Jun 20 11:12:25.347370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 313/632] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:25 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:25.521227 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:25.521847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:25.528882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.529340 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.530172 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.530582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.709128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:25.710019 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:25.717221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.717774 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.718692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:25.719179 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:25.901081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:25.912347 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8236e8c2-da53-4e19-9d47-aa9e879e5a92 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1689 microversion: 2.1 time: 0.395042 Jun 20 11:12:25.915322 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 320/633] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:25 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1689 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:25.947076 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:25.955214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1b25646b-25e0-47cf-9d5f-2b29e4c72b06 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.250045 Jun 20 11:12:25.955835 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 314/634] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:25 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:26.363655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:26.364292 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:26.371392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.371853 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.372637 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.373073 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.377093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:26.377714 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:26.384660 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.385131 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.385887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.386355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.520950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:26.530079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-22229ef4-3239-42e1-86e1-5b2884c9afa8 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.170374 Jun 20 11:12:26.530741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 321/635] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:26 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:26.605813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:26.614850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24500ca8-37c0-4192-88e4-c8f6a1bd2faa tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1755 microversion: 2.1 time: 0.241738 Jun 20 11:12:26.615451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 315/636] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:26 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:26.932318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:26.933068 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:26.939701 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.940238 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.941072 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.941551 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.971831 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:26.972547 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:26.979329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.979945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:26.980823 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:26.981351 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:27.087612 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:27.095348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-480a3117-94b5-4a8a-bd35-f4cf0dbe2831 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1689 microversion: 2.1 time: 0.167397 Jun 20 11:12:27.095931 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 322/637] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:26 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:27.231471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:27.239296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-26fa72c4-21eb-4147-bdb8-eb4ea6bbf0ea tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1574 microversion: 2.1 time: 0.271270 Jun 20 11:12:27.239874 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 316/638] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:26 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:27.405765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-6750455c-7970-415d-bd13-c382d7b24349 req-591ef094-55ac-4fe8-9f97-a2038c0ca53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda5e0fc-11d3-4bd6-ab13-5403531f371f", "name": "network-vif-deleted", "tag": "6ca3af82-3d2d-4c59-b7dc-43cea11de78e"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:27.414781 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6750455c-7970-415d-bd13-c382d7b24349 req-591ef094-55ac-4fe8-9f97-a2038c0ca53e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:27.415367 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6750455c-7970-415d-bd13-c382d7b24349 req-591ef094-55ac-4fe8-9f97-a2038c0ca53e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:27.428239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-6750455c-7970-415d-bd13-c382d7b24349 req-591ef094-55ac-4fe8-9f97-a2038c0ca53e service nova] Creating event network-vif-deleted:6ca3af82-3d2d-4c59-b7dc-43cea11de78e for instance fda5e0fc-11d3-4bd6-ab13-5403531f371f on hv-cinder-84614 Jun 20 11:12:27.437767 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-6750455c-7970-415d-bd13-c382d7b24349 req-591ef094-55ac-4fe8-9f97-a2038c0ca53e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035402 Jun 20 11:12:27.438865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 323/639] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:27.547451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:27.548067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:27.555194 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:27.556221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:27.557709 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:27.558166 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:27.704087 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:27.712110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cee81bc7-5773-4972-9611-750349dda85c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1361 microversion: 2.1 time: 0.168541 Jun 20 11:12:27.712696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 317/640] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:27 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:28.114302 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:28.115289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:28.122318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.122925 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.123844 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.124401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.203939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:28.213001 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2f8ca0ea-d84a-4a1b-b120-67b58daf40f1 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 200 len: 1330 microversion: 2.1 time: 0.103753 Jun 20 11:12:28.213860 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 324/641] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:28 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:28.257111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:28.257912 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:28.264665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.265105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.265867 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.266363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.403121 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:28.411185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9eacfb57-cfac-494e-91b0-17a64ba57798 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1561 microversion: 2.1 time: 0.158208 Jun 20 11:12:28.411797 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 318/642] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:28 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:28.729812 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:28.730467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:28.737477 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.737923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.738708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.739141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.878651 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:28.887157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-92d29be7-6eb8-4213-9e84-45dc55a2c525 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1547 microversion: 2.1 time: 0.161708 Jun 20 11:12:28.887726 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 325/643] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:28 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:28.904408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:28.904947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:28.911317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.911766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.912541 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:28.912986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:28.998819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-85ae0bd4-f06d-4bec-bcb7-93524cf2de27 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098671 Jun 20 11:12:29.000430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 319/644] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:12:28 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:29.232073 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:29.232687 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: fda5e0fc-11d3-4bd6-ab13-5403531f371f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:29.238777 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:29.239223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:29.240182 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:29.240798 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:29.256171 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] HTTP exception thrown: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f could not be found. Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Request method failure captured: Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f HTTP/1.1 Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ_azYavfpigFciMQdM673oO9M66LVlpfO6vi7JL7r0LFufoaT1eEo1Dp0ARIxFX3dsQ3eOG3gEcrSgZGaM7cMjLoetGkR1t0c8Ll8rEeLGLCoDJWdgjU1bagtAIwcAfQ3AE4eoc0RQSN5PWNrwAu38__EiGThC8z8ETCVlSIfvb_w Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:12:29.258696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 0c4a4ce86beb47c2b7910264a9238c8b Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f could not be found. Jun 20 11:12:29.260447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'fda5e0fc-11d3-4bd6-ab13-5403531f371f'} Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f could not be found. Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:12:29.261327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f could not be found. Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f could not be found. Jun 20 11:12:29.263351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:12:29.264973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Returning 404 to user: Instance fda5e0fc-11d3-4bd6-ab13-5403531f371f could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:12:29.264973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d373b74f-437c-4851-bc69-a2116ab20671 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f" status: 404 len: 111 microversion: 2.1 time: 0.033623 Jun 20 11:12:29.264973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 326/645] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:29 2022] GET /compute/v2.1/servers/fda5e0fc-11d3-4bd6-ab13-5403531f371f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:12:29.270721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0e95927a-71dc-426b-a12e-174d656db4d2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '.version_select at 0x7f7215ac31f0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:29.291332 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0e95927a-71dc-426b-a12e-174d656db4d2 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531437473" status: 202 len: 0 microversion: 2.1 time: 0.024749 Jun 20 11:12:29.291916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 320/646] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 20 11:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531437473 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:12:30.142373 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-746658e4-2c16-40f4-97ed-bba8584f0800 req-e9f7004a-46ef-4434-9980-d67348862a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a57fac4-93ed-4e53-b5b3-d18a1834707b", "tag": "85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:30.151752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-746658e4-2c16-40f4-97ed-bba8584f0800 req-e9f7004a-46ef-4434-9980-d67348862a6c service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:30.152192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-746658e4-2c16-40f4-97ed-bba8584f0800 req-e9f7004a-46ef-4434-9980-d67348862a6c service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:30.166493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-746658e4-2c16-40f4-97ed-bba8584f0800 req-e9f7004a-46ef-4434-9980-d67348862a6c service nova] Creating event network-changed:85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5 for instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b on hv-cinder-84614 Jun 20 11:12:30.171879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-746658e4-2c16-40f4-97ed-bba8584f0800 req-e9f7004a-46ef-4434-9980-d67348862a6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033537 Jun 20 11:12:30.173002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 327/647] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:32.405431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:32.405945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:32.412536 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:32.412983 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:32.413742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:32.414614 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:32.440885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:12:32.525116 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b977607-5811-486b-bb5e-75e4c184963c tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 204 len: 0 microversion: 2.1 time: 0.123243 Jun 20 11:12:32.528738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 321/648] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:12:32 2022] DELETE /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:12:32.534444 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:32.535145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:32.542222 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:32.542669 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:32.543438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:32.543873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:32.680723 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:32.691307 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a3f7de11-7f1f-4488-b6b2-13466bf1dc9a tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1506 microversion: 2.1 time: 0.161071 Jun 20 11:12:32.691881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 328/649] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:32 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:33.713802 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:33.714463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:33.721241 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:33.721691 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:33.722493 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:33.722926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:33.937698 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:33.945726 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ff2f2e22-49cf-4599-b14b-6e1c3c5da138 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 200 len: 1506 microversion: 2.1 time: 0.236421 Jun 20 11:12:33.946352 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 322/650] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:33 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:34.104820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-0ef02d34-b31c-4c25-862b-ee45b42507ba req-7a69f3fa-4f91-4542-955a-2b2b53716f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd1d65c-bf4a-4973-97ca-7263bd5e6dde", "name": "network-vif-deleted", "tag": "5ba94606-ffa2-4ad9-96db-221a22bbb4b4"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:34.116888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0ef02d34-b31c-4c25-862b-ee45b42507ba req-7a69f3fa-4f91-4542-955a-2b2b53716f42 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:34.117511 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0ef02d34-b31c-4c25-862b-ee45b42507ba req-7a69f3fa-4f91-4542-955a-2b2b53716f42 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:34.130919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-0ef02d34-b31c-4c25-862b-ee45b42507ba req-7a69f3fa-4f91-4542-955a-2b2b53716f42 service nova] Creating event network-vif-deleted:5ba94606-ffa2-4ad9-96db-221a22bbb4b4 for instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde on hv-cinder-84614 Jun 20 11:12:34.136641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-0ef02d34-b31c-4c25-862b-ee45b42507ba req-7a69f3fa-4f91-4542-955a-2b2b53716f42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035919 Jun 20 11:12:34.137497 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 329/651] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:34.963485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:34.964094 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: abd1d65c-bf4a-4973-97ca-7263bd5e6dde] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:34.970708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:34.971159 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:34.971920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:34.972382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:34.986961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] HTTP exception thrown: Instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde could not be found. Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Request method failure captured: Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde HTTP/1.1 Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ_azYavfpigFciMQdM673oO9M66LVlpfO6vi7JL7r0LFufoaT1eEo1Dp0ARIxFX3dsQ3eOG3gEcrSgZGaM7cMjLoetGkR1t0c8Ll8rEeLGLCoDJWdgjU1bagtAIwcAfQ3AE4eoc0RQSN5PWNrwAu38__EiGThC8z8ETCVlSIfvb_w Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:12:34.988287 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 0c4a4ce86beb47c2b7910264a9238c8b Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde could not be found. Jun 20 11:12:34.989775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'abd1d65c-bf4a-4973-97ca-7263bd5e6dde'} Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde could not be found. Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:12:34.990653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde could not be found. Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde could not be found. Jun 20 11:12:34.992173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:34.993821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Returning 404 to user: Instance abd1d65c-bf4a-4973-97ca-7263bd5e6dde could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:12:34.993821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-58de0328-8b80-4f17-a48f-43d5c9e70c85 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde" status: 404 len: 111 microversion: 2.1 time: 0.030437 Jun 20 11:12:34.993821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 323/652] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:34 2022] GET /compute/v2.1/servers/abd1d65c-bf4a-4973-97ca-7263bd5e6dde => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:12:35.000494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:35.001080 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:35.008165 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:35.008824 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:35.009616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:35.010054 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:35.036987 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:12:35.125486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-281392c1-2d67-49c2-a1ba-23b45d4d30cf tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 204 len: 0 microversion: 2.1 time: 0.128880 Jun 20 11:12:35.126657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 330/653] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:12:34 2022] DELETE /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:12:35.135738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:35.136350 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:35.142878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:35.143325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:35.144093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:35.144524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:35.279871 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:35.287472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7ad1b320-584f-4c49-badb-30ea3d9c74e9 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1518 microversion: 2.1 time: 0.155877 Jun 20 11:12:35.288042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 324/654] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:35 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:36.306916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:36.307614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:36.314548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:36.314994 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:36.315751 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:36.316179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:36.343077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-395175f2-8aa6-4b63-9b00-68e67a235889 req-fef7f03a-363f-402b-97b5-b21a0a99999b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8963e2f6-7da5-4629-83bf-1ee968229650", "name": "network-vif-deleted", "tag": "d17429a4-6d58-49e4-ad27-780b92838339"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:36.352745 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-395175f2-8aa6-4b63-9b00-68e67a235889 req-fef7f03a-363f-402b-97b5-b21a0a99999b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:36.353116 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-395175f2-8aa6-4b63-9b00-68e67a235889 req-fef7f03a-363f-402b-97b5-b21a0a99999b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:36.368443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-395175f2-8aa6-4b63-9b00-68e67a235889 req-fef7f03a-363f-402b-97b5-b21a0a99999b service nova] Creating event network-vif-deleted:d17429a4-6d58-49e4-ad27-780b92838339 for instance 8963e2f6-7da5-4629-83bf-1ee968229650 on hv-cinder-84614 Jun 20 11:12:36.375168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-395175f2-8aa6-4b63-9b00-68e67a235889 req-fef7f03a-363f-402b-97b5-b21a0a99999b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035453 Jun 20 11:12:36.376652 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 325/655] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:36.386887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c4a4ce86beb47c2b7910264a9238c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cab4c10ddc745418a470e5d50b77bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:36.395957 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-977005b3-2dbc-47a2-9f6a-994813f9c881 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 200 len: 1476 microversion: 2.1 time: 0.093647 Jun 20 11:12:36.396532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 331/656] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:36 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 1476 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:12:37.414282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:37.415164 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] [instance: 8963e2f6-7da5-4629-83bf-1ee968229650] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:37.422315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:37.422770 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:37.423557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:37.423992 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:37.440838 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] HTTP exception thrown: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 could not be found. Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Request method failure captured: Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 HTTP/1.1 Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ_azYavfpigFciMQdM673oO9M66LVlpfO6vi7JL7r0LFufoaT1eEo1Dp0ARIxFX3dsQ3eOG3gEcrSgZGaM7cMjLoetGkR1t0c8Ll8rEeLGLCoDJWdgjU1bagtAIwcAfQ3AE4eoc0RQSN5PWNrwAu38__EiGThC8z8ETCVlSIfvb_w Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:12:37.442561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4cab4c10ddc745418a470e5d50b77bea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 4cab4c10ddc745418a470e5d50b77bea Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1442435504 Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 0c4a4ce86beb47c2b7910264a9238c8b Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1442435504-project Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 could not be found. Jun 20 11:12:37.444075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '8963e2f6-7da5-4629-83bf-1ee968229650'} Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 could not be found. Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:12:37.444989 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 could not be found. Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 could not be found. Jun 20 11:12:37.447174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:12:37.448455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] Returning 404 to user: Instance 8963e2f6-7da5-4629-83bf-1ee968229650 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:12:37.448455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8720bf85-63a5-463e-989e-f33e041c0825 tempest-ServerRescueNegativeTestJSON-1442435504 tempest-ServerRescueNegativeTestJSON-1442435504-project] 10.222.0.33 "GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650" status: 404 len: 111 microversion: 2.1 time: 0.034380 Jun 20 11:12:37.448455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 326/657] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:12:37 2022] GET /compute/v2.1/servers/8963e2f6-7da5-4629-83bf-1ee968229650 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:12:46.159059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1db5386e-c6aa-4aaf-aca9-4b12aee6c92c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'create', calling method: .version_select at 0x7f72150309d0>, body: {"keypair": {"name": "tempest-keypair-528954725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyDG/+SP+hj332+gZhngLNk3GHWvR7PWDsHyV9g3dCBhBFYE6y8paMAoiy+n+H+RDSDAxXiqiFcFtOfuNwjDo57XL+xJ+aRPU+zPw5wFDrTBg3vWfnecc6Yos0pg6mPfg=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:46.173371 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1db5386e-c6aa-4aaf-aca9-4b12aee6c92c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for project 5778b58ba0bb4bebb334d08971c67323. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:12:46.177291 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1db5386e-c6aa-4aaf-aca9-4b12aee6c92c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for user b7275026b00b4e93bed7682b3ff2525c and project 5778b58ba0bb4bebb334d08971c67323. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:12:46.204589 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1db5386e-c6aa-4aaf-aca9-4b12aee6c92c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.175969 Jun 20 11:12:46.205204 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 332/658] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jun 20 11:12:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 11:12:47.780705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-275798511", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "504cbbcf-5657-42f1-92b8-430ba48b2c83"}], "security_groups": [{"name": "tempest-securitygroup--887037659"}], "key_name": "tempest-keypair-528954725", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:47.787568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:47.788202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:47.892599 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] validate_networks() for [('504cbbcf-5657-42f1-92b8-430ba48b2c83', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:12:48.516829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:12:48.517248 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:12:48.517708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:12:48.518119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:12:48.518503 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:12:48.529292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:48.529717 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:48.530566 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:48.531143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:48.549990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for project 5778b58ba0bb4bebb334d08971c67323. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:12:48.555816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for user b7275026b00b4e93bed7682b3ff2525c and project 5778b58ba0bb4bebb334d08971c67323. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:12:48.569919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:12:48.572255 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:12:48.621011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-edf19cd7-2034-4087-a2f0-4a93d133d763 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.844810 Jun 20 11:12:48.621928 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 327/659] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jun 20 11:12:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 11:12:48.629099 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:48.633872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7a4d1176-a28c-4700-bad5-7ea38c0a1eac tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:48.634509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7a4d1176-a28c-4700-bad5-7ea38c0a1eac tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:48.706740 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7a4d1176-a28c-4700-bad5-7ea38c0a1eac tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:48.715122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7a4d1176-a28c-4700-bad5-7ea38c0a1eac tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:48.718548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7a4d1176-a28c-4700-bad5-7ea38c0a1eac tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:48.719736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7a4d1176-a28c-4700-bad5-7ea38c0a1eac tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1280 microversion: 2.20 time: 0.091532 Jun 20 11:12:48.720837 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 333/660] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:48 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:49.737608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:49.738837 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:49.746198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:49.746858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:49.747785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:49.748216 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:49.876336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:49.889037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:49.891058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:49.893022 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2507f52a-88cb-4e34-bf33-78787b4671ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1332 microversion: 2.20 time: 0.159595 Jun 20 11:12:49.893790 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 328/661] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:49 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1332 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:50.912172 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:50.912928 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:50.921501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:50.921969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:50.922775 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:50.923210 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:51.054226 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:51.063505 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:51.065030 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:51.066159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-76e5230d-e90b-4f3f-891a-a6c3c08bc087 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.158134 Jun 20 11:12:51.066785 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 334/662] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:50 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:51.360266 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-eef61ef9-656d-4b3f-b707-746724e7df30 req-0b641b1e-972c-4092-8281-660acff077fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:51.369848 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-eef61ef9-656d-4b3f-b707-746724e7df30 req-0b641b1e-972c-4092-8281-660acff077fe service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:51.370331 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-eef61ef9-656d-4b3f-b707-746724e7df30 req-0b641b1e-972c-4092-8281-660acff077fe service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:51.383308 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-eef61ef9-656d-4b3f-b707-746724e7df30 req-0b641b1e-972c-4092-8281-660acff077fe service nova] Creating event network-changed:4865ebb8-bb27-4185-b60c-1808baf91968 for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 on hv-cinder-84614 Jun 20 11:12:51.388895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-eef61ef9-656d-4b3f-b707-746724e7df30 req-0b641b1e-972c-4092-8281-660acff077fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032701 Jun 20 11:12:51.389919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 329/663] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:52.085283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:52.085980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:52.088362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:52.093694 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:52.094152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:52.094950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:52.095385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:52.239698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:52.249638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:52.251214 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:52.252354 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ae175255-98cb-43c0-be7d-a9524a80fab3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.171186 Jun 20 11:12:52.252931 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 335/664] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:52 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:53.272416 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:53.273077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:53.280519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:53.280958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:53.281739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:53.282234 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:53.415318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:53.423680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:53.425207 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:53.426369 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-caa92894-1b65-47e5-b550-da631cf13f20 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.158286 Jun 20 11:12:53.426919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 330/665] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:53 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:54.445067 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:54.445655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:54.453226 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:54.453699 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:54.454518 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:54.454961 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:54.603878 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:54.612607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:54.614143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:54.615279 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cfbc93d8-c393-4c09-bbf6-b6c6e523897c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.174366 Jun 20 11:12:54.615849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 336/666] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:54 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:55.634167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:55.634774 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:55.641366 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:55.641818 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:55.642628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:55.643061 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:55.775709 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:55.783846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:55.785339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:55.786473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e6414865-f788-40eb-bb9c-22d32b131b29 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.156719 Jun 20 11:12:55.787312 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 331/667] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:55 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:56.804774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:56.805379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:56.813890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:56.814381 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:56.815150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:56.815590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:56.947237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:56.955501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:56.956979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:56.958075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-08fefb85-a50c-4ecb-acdb-aa8c1d7cd95a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.157378 Jun 20 11:12:56.958660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 337/668] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:56 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:57.912403 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a09dff39-1ba1-4b6d-9b68-fb7dfe87da6f req-beb9157e-a8e6-4c3d-bdca-7175b85e1b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "name": "network-vif-plugged", "status": "completed", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:12:57.920543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a09dff39-1ba1-4b6d-9b68-fb7dfe87da6f req-beb9157e-a8e6-4c3d-bdca-7175b85e1b5e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:57.921093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a09dff39-1ba1-4b6d-9b68-fb7dfe87da6f req-beb9157e-a8e6-4c3d-bdca-7175b85e1b5e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:57.933949 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a09dff39-1ba1-4b6d-9b68-fb7dfe87da6f req-beb9157e-a8e6-4c3d-bdca-7175b85e1b5e service nova] Creating event network-vif-plugged:4865ebb8-bb27-4185-b60c-1808baf91968 for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 on hv-cinder-84614 Jun 20 11:12:57.939626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a09dff39-1ba1-4b6d-9b68-fb7dfe87da6f req-beb9157e-a8e6-4c3d-bdca-7175b85e1b5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Jun 20 11:12:57.940901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 332/669] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:12:57.976919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:57.977540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:57.985807 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:57.986416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:57.987348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:57.987799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:58.146397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:58.155149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:58.156634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:58.157746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-29f62280-a3b3-4ee5-95fc-b8766ccec7d9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.185125 Jun 20 11:12:58.158778 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 338/670] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:57 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:12:59.176812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:12:59.177690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:12:59.179777 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:59.180459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:12:59.187494 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:59.187930 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:59.188689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:12:59.189112 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:12:59.323170 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:59.331585 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:59.333054 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:12:59.334152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-db2a6657-d01e-4546-b333-01cd6149e534 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1405 microversion: 2.20 time: 0.162050 Jun 20 11:12:59.334734 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 333/671] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:12:59 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:13:00.353433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:00.354047 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:00.355934 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:13:00.362045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:00.362587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:00.363348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:00.363775 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:00.495306 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:00.503636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:00.505116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:00.506298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f84f6c58-e855-46c3-af49-2fd82ea1c6c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1598 microversion: 2.20 time: 0.157431 Jun 20 11:13:00.506856 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 339/672] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:13:00 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:13:00.524271 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:00.524870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:00.531015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:00.531454 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:00.532198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:00.532629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:00.611446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a583b74f-fadb-4f67-b6c8-75eacdac065b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091653 Jun 20 11:13:00.612054 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 334/673] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jun 20 11:13:00 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:13:01.548976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-725a5f3b-a991-424e-857d-3a680c13419e req-fff29b54-8fb0-432a-b3f6-ea7a7ece75a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:01.557993 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-725a5f3b-a991-424e-857d-3a680c13419e req-fff29b54-8fb0-432a-b3f6-ea7a7ece75a9 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:01.558474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-725a5f3b-a991-424e-857d-3a680c13419e req-fff29b54-8fb0-432a-b3f6-ea7a7ece75a9 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:01.569874 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-725a5f3b-a991-424e-857d-3a680c13419e req-fff29b54-8fb0-432a-b3f6-ea7a7ece75a9 service nova] Creating event network-changed:4865ebb8-bb27-4185-b60c-1808baf91968 for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 on hv-cinder-84614 Jun 20 11:13:01.575140 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-725a5f3b-a991-424e-857d-3a680c13419e req-fff29b54-8fb0-432a-b3f6-ea7a7ece75a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029829 Jun 20 11:13:01.575724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 340/674] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:13:33.796880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:13:33.797698 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:13:33.802590 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-108185545"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:33.803126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:33.811049 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:33.811498 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:33.812267 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:33.812695 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:33.954674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.network.security_group_api [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Removing security group abf9203b-5b39-4977-a8ca-f38a8d03a8a3 from port ab81e9b0-cbd5-41b5-be2d-efcb9c31940f Jun 20 11:13:34.324637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-07b0f467-bdf5-4077-b11e-2753cbfaf47c tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/action" status: 202 len: 0 microversion: 2.1 time: 0.529411 Jun 20 11:13:34.326197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 335/675] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 20 11:13:33 2022] POST /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:13:34.332761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-bf16339e-a861-47b6-8efc-2243b4f7983c req-9eb15df3-589a-4750-a48a-babcaa01deb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:34.341791 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=11 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:13:34.344050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=38 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:13:34.347402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-bf16339e-a861-47b6-8efc-2243b4f7983c req-9eb15df3-589a-4750-a48a-babcaa01deb5 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:34.347971 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-bf16339e-a861-47b6-8efc-2243b4f7983c req-9eb15df3-589a-4750-a48a-babcaa01deb5 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:34.364295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-bf16339e-a861-47b6-8efc-2243b4f7983c req-9eb15df3-589a-4750-a48a-babcaa01deb5 service nova] Creating event network-changed:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:13:34.372335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-bf16339e-a861-47b6-8efc-2243b4f7983c req-9eb15df3-589a-4750-a48a-babcaa01deb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043881 Jun 20 11:13:34.373236 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 341/676] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:13:35.619134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:35.619664 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:35.621812 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-9942d1bf-2b21-40fb-9968-ad22102439e0 req-9547f970-d9a8-47d3-a82c-b374e25fb2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:35.626738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:35.627339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:35.628188 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:35.628699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:35.630737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-9942d1bf-2b21-40fb-9968-ad22102439e0 req-9547f970-d9a8-47d3-a82c-b374e25fb2f2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:35.631289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-9942d1bf-2b21-40fb-9968-ad22102439e0 req-9547f970-d9a8-47d3-a82c-b374e25fb2f2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:35.642802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-9942d1bf-2b21-40fb-9968-ad22102439e0 req-9547f970-d9a8-47d3-a82c-b374e25fb2f2 service nova] Creating event network-changed:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:13:35.648048 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-9942d1bf-2b21-40fb-9968-ad22102439e0 req-9547f970-d9a8-47d3-a82c-b374e25fb2f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030673 Jun 20 11:13:35.648787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 342/677] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:13:35.714997 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lazy-loading 'services' on Instance uuid 375f59d2-83f7-4d4c-9c6f-61943d6f962f {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:13:35.797889 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a66aa51b-8855-41ae-8d3c-57b43fa5ab41 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments/9fd9a295-7b01-4ad5-824d-c836ebdbca1a" status: 202 len: 0 microversion: 2.1 time: 0.182573 Jun 20 11:13:35.799000 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 336/678] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:13:35 2022] DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments/9fd9a295-7b01-4ad5-824d-c836ebdbca1a => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:13:35.807667 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:35.809023 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:35.817377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:35.818005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:35.818905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:35.819561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:35.851094 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7c149c01-5e41-48cd-9f0a-a1aca03aeae9 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047795 Jun 20 11:13:35.851870 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 343/679] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:13:35 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:13:36.864672 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:36.865743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:36.872566 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:36.873009 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:36.873762 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:36.874214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:36.904778 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0dabcf4c-5680-422f-bba5-c5b06e000821 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045149 Jun 20 11:13:36.905329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 337/680] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:13:36 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:13:36.915614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:36.916075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:36.923081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:36.923533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:36.924826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:36.925257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:37.003586 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] HTTP exception thrown: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f is not attached to volume 9fd9a295-7b01-4ad5-824d-c836ebdbca1a Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Request method failure captured: Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments/9fd9a295-7b01-4ad5-824d-c836ebdbca1a HTTP/1.1 Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFWKw9jfPMJzl7Gkxh1iVF4hylB5X3A2apwstyFLN4aOaG-x_5qznUSweydsPhcfq6CKANktXeq2fjxsiWXJ0tO7vu1hX1iiUHc8itzphDlxzLs0dOZhKFcKdj-QxdksTc-OzlArNvb7JQC1u_5qL2-txA-SZ7znhETeIzj1lpHsWzM Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: fdaa800381f948619a950d65f637c16a Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-TestMinimumBasicScenario-25836569 Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:13:37.005906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fdaa800381f948619a950d65f637c16a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fdaa800381f948619a950d65f637c16a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fdaa800381f948619a950d65f637c16a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fdaa800381f948619a950d65f637c16a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-TestMinimumBasicScenario-25836569 Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: fdaa800381f948619a950d65f637c16a Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-TestMinimumBasicScenario-25836569 Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-TestMinimumBasicScenario-25836569-project Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: ca6820ed031b49a8b3f6cff4ad7a899d Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-TestMinimumBasicScenario-25836569-project Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:13:37.007524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f is not attached to volume 9fd9a295-7b01-4ad5-824d-c836ebdbca1a Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'server_id': '375f59d2-83f7-4d4c-9c6f-61943d6f962f', 'id': '9fd9a295-7b01-4ad5-824d-c836ebdbca1a'} Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9fd9a295-7b01-4ad5-824d-c836ebdbca1a. Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:13:37.012838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f is not attached to volume 9fd9a295-7b01-4ad5-824d-c836ebdbca1a Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f is not attached to volume 9fd9a295-7b01-4ad5-824d-c836ebdbca1a Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:13:37.014394 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Returning 404 to user: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f is not attached to volume 9fd9a295-7b01-4ad5-824d-c836ebdbca1a {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:13:37.015712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4057e026-7b11-4948-9a5a-accca01999e1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments/9fd9a295-7b01-4ad5-824d-c836ebdbca1a" status: 404 len: 154 microversion: 2.1 time: 0.095776 Jun 20 11:13:37.015712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 344/681] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:13:36 2022] DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f/os-volume_attachments/9fd9a295-7b01-4ad5-824d-c836ebdbca1a => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:13:38.162967 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:38.163496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:38.170134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:38.170614 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:38.171371 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:38.171799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:38.198353 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:13:38.288772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-926a1d6d-eb40-4d51-99c3-594b8e5699b1 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 204 len: 0 microversion: 2.1 time: 0.131354 Jun 20 11:13:38.289732 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 338/682] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:13:38 2022] DELETE /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:13:38.297964 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:38.298621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:38.308148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:38.308598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:38.309405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:38.309839 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:38.462128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:38.470587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-324cda7c-0f66-4a37-a669-6586571bffd2 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1551 microversion: 2.1 time: 0.176484 Jun 20 11:13:38.471154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 345/683] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:38 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:39.489198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:39.489958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:39.496545 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:39.496991 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:39.497726 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:39.498231 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:39.633059 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:39.640951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9abb95e3-af18-4329-b0a1-62abc5850162 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1551 microversion: 2.1 time: 0.156178 Jun 20 11:13:39.641517 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 339/684] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:39 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:40.659469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:40.660185 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:40.667166 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:40.667641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:40.668412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:40.668844 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:40.800167 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:40.808177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c29b9ef8-9039-4f43-a527-0c44f442a097 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1551 microversion: 2.1 time: 0.152762 Jun 20 11:13:40.808846 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 346/685] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:40 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:40.882004 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-8b350ac6-8de2-46a1-96f7-483dc2b92f07 req-fecbef49-8f58-41aa-a9b8-79c4c373e3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375f59d2-83f7-4d4c-9c6f-61943d6f962f", "name": "network-vif-deleted", "tag": "ab81e9b0-cbd5-41b5-be2d-efcb9c31940f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:40.890753 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8b350ac6-8de2-46a1-96f7-483dc2b92f07 req-fecbef49-8f58-41aa-a9b8-79c4c373e3fc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:40.891226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8b350ac6-8de2-46a1-96f7-483dc2b92f07 req-fecbef49-8f58-41aa-a9b8-79c4c373e3fc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:40.902398 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-8b350ac6-8de2-46a1-96f7-483dc2b92f07 req-fecbef49-8f58-41aa-a9b8-79c4c373e3fc service nova] Creating event network-vif-deleted:ab81e9b0-cbd5-41b5-be2d-efcb9c31940f for instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f on hv-cinder-84614 Jun 20 11:13:40.907363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-8b350ac6-8de2-46a1-96f7-483dc2b92f07 req-fecbef49-8f58-41aa-a9b8-79c4c373e3fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029223 Jun 20 11:13:40.907952 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 340/686] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:13:41.828832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:41.829371 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:41.836953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:41.837404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:41.838221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:41.838641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:41.909694 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:41.917553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c6cd5ba7-187a-40fb-b16a-fb70ccd64076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1340 microversion: 2.1 time: 0.095180 Jun 20 11:13:41.918127 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 347/687] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:41 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1340 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:42.941021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:42.941724 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:42.948543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:42.948988 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:42.949754 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:42.950221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:43.018335 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:43.026015 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7693dade-9921-4b2a-ba37-31898e356292 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1340 microversion: 2.1 time: 0.092325 Jun 20 11:13:43.026615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 341/688] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:42 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:44.044010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:44.044613 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:44.051930 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:44.052379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:44.053150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:44.053584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:44.086795 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:44.087119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:44.087568 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lazy-loading 'fault' on Instance uuid 375f59d2-83f7-4d4c-9c6f-61943d6f962f {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:13:44.131519 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6820ed031b49a8b3f6cff4ad7a899d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdaa800381f948619a950d65f637c16a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:44.139320 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c20f1b24-84f7-48e5-9ca6-4bfc178d6dcc tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 200 len: 1345 microversion: 2.1 time: 0.100179 Jun 20 11:13:44.139882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 348/689] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:44 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:45.156345 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:45.157649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] [instance: 375f59d2-83f7-4d4c-9c6f-61943d6f962f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:45.165663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:45.166348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:45.167197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:45.167671 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:45.181946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] HTTP exception thrown: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f could not be found. Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Request method failure captured: Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f HTTP/1.1 Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFWKw9jfPMJzl7Gkxh1iVF4hylB5X3A2apwstyFLN4aOaG-x_5qznUSweydsPhcfq6CKANktXeq2fjxsiWXJ0tO7vu1hX1iiUHc8itzphDlxzLs0dOZhKFcKdj-QxdksTc-OzlArNvb7JQC1u_5qL2-txA-SZ7znhETeIzj1lpHsWzM Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: fdaa800381f948619a950d65f637c16a Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestMinimumBasicScenario-25836569 Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:13:45.183626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fdaa800381f948619a950d65f637c16a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fdaa800381f948619a950d65f637c16a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fdaa800381f948619a950d65f637c16a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fdaa800381f948619a950d65f637c16a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestMinimumBasicScenario-25836569 Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: fdaa800381f948619a950d65f637c16a Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestMinimumBasicScenario-25836569 Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-TestMinimumBasicScenario-25836569-project Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: ca6820ed031b49a8b3f6cff4ad7a899d Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestMinimumBasicScenario-25836569-project Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f could not be found. Jun 20 11:13:45.185148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '375f59d2-83f7-4d4c-9c6f-61943d6f962f'} Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f could not be found. Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:13:45.186484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f could not be found. Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f could not be found. Jun 20 11:13:45.187996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:13:45.189573 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Returning 404 to user: Instance 375f59d2-83f7-4d4c-9c6f-61943d6f962f could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:13:45.189573 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-31e5dd21-2e0f-46a2-8c2c-18a7d780b076 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f" status: 404 len: 111 microversion: 2.1 time: 0.032561 Jun 20 11:13:45.189573 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 342/690] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:45 2022] GET /compute/v2.1/servers/375f59d2-83f7-4d4c-9c6f-61943d6f962f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:13:45.194321 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dff2ab2f-48f3-4b7b-b8cd-a31b3d099f74 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] Calling method '.version_select at 0x7f7215065dc0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:45.216090 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dff2ab2f-48f3-4b7b-b8cd-a31b3d099f74 tempest-TestMinimumBasicScenario-25836569 tempest-TestMinimumBasicScenario-25836569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-8892953" status: 202 len: 0 microversion: 2.1 time: 0.025751 Jun 20 11:13:45.216671 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 349/691] 10.222.0.33 () {58 vars in 1262 bytes} [Mon Jun 20 11:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-8892953 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:13:50.970167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1793108720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1558821828", "security_groups": [{"name": "tempest-secgroup-smoke-1979074994"}], "block_device_mapping_v2": [{"uuid": "c33cb121-6055-4ec7-ac1f-fe1d0a09e5dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7129602-ccc0-484b-85f3-177744b5235e"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:51.095273 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] validate_networks() for [('f7129602-ccc0-484b-85f3-177744b5235e', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:13:51.485977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:13:51.486923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:13:51.487423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:13:51.487816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:13:51.488218 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:13:51.498884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:51.499328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:51.500102 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:51.500537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:51.520399 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for project 17bb5c3721fc4505a51879dae4762b43. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:13:51.524775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Getting quotas for user ee21ef9eacd24177a852f28d17376191 and project 17bb5c3721fc4505a51879dae4762b43. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:13:51.596214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:13:51.600547 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c33cb121-6055-4ec7-ac1f-fe1d0a09e5dc',volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:13:51.751033 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-afdc3e00-75c2-4697-9291-467bbb31ccbf tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785326 Jun 20 11:13:51.752011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 343/692] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:13:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:13:51.774297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5be3c53c-677a-484a-8661-a3e162beb53b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:51.774977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5be3c53c-677a-484a-8661-a3e162beb53b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:51.994283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5be3c53c-677a-484a-8661-a3e162beb53b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:52.003491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5be3c53c-677a-484a-8661-a3e162beb53b tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1095 microversion: 2.1 time: 0.244989 Jun 20 11:13:52.004240 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 350/693] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:51 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1095 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:53.021850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:53.023128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:53.031632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:53.032312 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:53.033304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:53.033929 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:53.128167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:53.136987 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb190f97-1140-4d26-91bf-ee72e99c34dc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1211 microversion: 2.1 time: 0.119277 Jun 20 11:13:53.138122 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 344/694] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:53 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:54.154622 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:54.155273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:54.158259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=42 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:13:54.164025 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:54.164473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:54.165248 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:54.165825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:54.311013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:54.319236 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-570884e3-7106-46e9-b5eb-3a8478a01df7 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.168461 Jun 20 11:13:54.319737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 351/695] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:54 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:54.654889 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-22227793-0c2f-412a-b471-0ba99a26cad2 req-45d062fc-8fb2-4d81-bef1-cd013e91f73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a914d5-de24-456e-8214-b1aea3be01d3", "tag": "c7f3de09-c75f-445f-98c5-4dbaae29e1be"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:13:54.665926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-22227793-0c2f-412a-b471-0ba99a26cad2 req-45d062fc-8fb2-4d81-bef1-cd013e91f73d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:54.666408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-22227793-0c2f-412a-b471-0ba99a26cad2 req-45d062fc-8fb2-4d81-bef1-cd013e91f73d service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:54.682638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-22227793-0c2f-412a-b471-0ba99a26cad2 req-45d062fc-8fb2-4d81-bef1-cd013e91f73d service nova] Creating event network-changed:c7f3de09-c75f-445f-98c5-4dbaae29e1be for instance 49a914d5-de24-456e-8214-b1aea3be01d3 on hv-cinder-84614 Jun 20 11:13:54.688006 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-22227793-0c2f-412a-b471-0ba99a26cad2 req-45d062fc-8fb2-4d81-bef1-cd013e91f73d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038182 Jun 20 11:13:54.688592 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 345/696] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:13:55.337879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:55.338584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:55.346946 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:55.347385 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:55.348337 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:55.349209 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:55.496835 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:55.504906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c04e6fd6-425d-4bc6-bb3f-49221251f789 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.171628 Jun 20 11:13:55.505466 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 352/697] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:55 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:56.522272 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:56.522968 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:56.529721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:56.530200 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:56.530961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:56.531388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:56.669643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:56.679815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9e9cc3af-5d68-47df-9591-545f7f3f3ce4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.162505 Jun 20 11:13:56.680364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 346/698] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:56 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:57.697545 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:57.698308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:57.705448 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:57.705882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:57.706684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:57.707116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:57.844471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:57.855571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e5952e39-079d-4b7f-b0bd-aff8ee5473e8 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.161951 Jun 20 11:13:57.856378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 353/699] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:57 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:13:58.880078 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:13:58.881050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:13:58.891676 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:58.892423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:58.893690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:13:58.894458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:13:59.047887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:13:59.061065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3a06cd9a-5b3a-4110-acd8-c4da1f9060f5 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.186837 Jun 20 11:13:59.061985 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 347/700] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:13:58 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:00.085611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:00.086252 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:00.093807 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:00.094403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:00.095291 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:00.095770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:00.231162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:00.239033 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-07187d02-95d7-4d0f-ac0e-c56441732e40 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.160098 Jun 20 11:14:00.239608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 354/701] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:00 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:00.248539 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:00.249093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:00.255846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:00.256291 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:00.257078 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:00.258069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:00.286812 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49b9d7cb-cd59-40f4-8368-ded6c260b9a2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/ips" status: 200 len: 146 microversion: 2.1 time: 0.041800 Jun 20 11:14:00.287563 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 348/702] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:14:00 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:01.256410 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:01.257016 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:01.264280 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:01.264737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:01.265513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:01.265944 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:01.410963 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:01.419308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-396f0c3f-c0f3-4cdd-8fc6-9d9b72ea7c77 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.166852 Jun 20 11:14:01.419891 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 355/703] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:01 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:01.651963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69bb300-2c6a-45a2-baeb-332befe50f2d"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:01.653044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:01.655104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:01.655757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:01.662359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:01.662822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:01.663657 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:01.664118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:02.436518 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:02.437055 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:02.438955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:02.445832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:02.446312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:02.447092 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:02.447512 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:02.564598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1d759d2e-01cd-4a5d-8e1e-f3a3aabae3f9 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.916373 Jun 20 11:14:02.565269 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 349/704] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:14:01 2022] POST /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:02.598443 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:02.612478 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-92d4cee6-afb8-4254-bd9c-77583e2c3a09 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.180289 Jun 20 11:14:02.613293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 356/705] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:02 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:03.637235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:03.638275 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:03.649191 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:03.649635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:03.650450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:03.650877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:03.793986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:03.801792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d652609-0e49-4810-870f-be0564fed20f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.174081 Jun 20 11:14:03.802463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 350/706] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:03 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:04.820527 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:04.821865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:04.825196 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:04.831775 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:04.832219 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:04.834894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:04.834894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:04.976218 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:04.985075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fd06cc0d-5aee-4d07-b0e1-8f0d8c806b79 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.169597 Jun 20 11:14:04.985649 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 357/707] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:04 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:06.004364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:06.004975 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:06.007517 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:06.013332 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:06.013776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:06.014581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:06.015009 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:06.018521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:06.163340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:06.171816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2e066ada-dc48-4405-8102-77b9c874b687 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.173250 Jun 20 11:14:06.172385 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 351/708] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:05 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:06.872674 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-ccb1a3ca-445b-4c71-965e-796117ab561c req-825ba12a-5f56-413e-a7ea-bbe390e488fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a914d5-de24-456e-8214-b1aea3be01d3", "name": "network-vif-plugged", "status": "completed", "tag": "c7f3de09-c75f-445f-98c5-4dbaae29e1be"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:06.883696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ccb1a3ca-445b-4c71-965e-796117ab561c req-825ba12a-5f56-413e-a7ea-bbe390e488fd service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:06.884162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ccb1a3ca-445b-4c71-965e-796117ab561c req-825ba12a-5f56-413e-a7ea-bbe390e488fd service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:06.896715 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-ccb1a3ca-445b-4c71-965e-796117ab561c req-825ba12a-5f56-413e-a7ea-bbe390e488fd service nova] Creating event network-vif-plugged:c7f3de09-c75f-445f-98c5-4dbaae29e1be for instance 49a914d5-de24-456e-8214-b1aea3be01d3 on hv-cinder-84614 Jun 20 11:14:06.902956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-ccb1a3ca-445b-4c71-965e-796117ab561c req-825ba12a-5f56-413e-a7ea-bbe390e488fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035497 Jun 20 11:14:06.904065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 358/709] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:07.189475 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:07.190131 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:07.197659 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:07.198487 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:07.200340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:07.200908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:07.343601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:07.351465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8d1d80f0-c234-4414-b750-3c9a61d46041 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.166908 Jun 20 11:14:07.352032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 352/710] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:07 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:08.369676 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:08.370399 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:08.377741 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:08.378266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:08.379050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:08.379638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:08.766750 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:08.774608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e161cb5e-1d46-4d1a-b47f-2c65aa2714ac tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1267 microversion: 2.1 time: 0.409152 Jun 20 11:14:08.775184 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 359/711] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:08 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:09.020110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:09.020701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:09.023035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-dfcf3a47-931b-483b-a368-df36afc82535 req-bc1397b8-ee97-48cb-96ef-e8970173e735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:09.027606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.028059 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.028835 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.029269 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.032377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-dfcf3a47-931b-483b-a368-df36afc82535 req-bc1397b8-ee97-48cb-96ef-e8970173e735 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.032929 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-dfcf3a47-931b-483b-a368-df36afc82535 req-bc1397b8-ee97-48cb-96ef-e8970173e735 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.045324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-dfcf3a47-931b-483b-a368-df36afc82535 req-bc1397b8-ee97-48cb-96ef-e8970173e735 service nova] Creating event network-changed:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:14:09.050440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-dfcf3a47-931b-483b-a368-df36afc82535 req-bc1397b8-ee97-48cb-96ef-e8970173e735 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 Jun 20 11:14:09.051149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 360/712] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:14:09.058914 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:14:09.154214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a62c730-973b-4024-b47a-dd39e3309eb8 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 204 len: 0 microversion: 2.1 time: 0.137571 Jun 20 11:14:09.154822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 353/713] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:14:09 2022] DELETE /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:14:09.163561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:09.164273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:09.171360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.171879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.172707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.173211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.311215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:09.318894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-651d231b-9ad5-469c-812b-bbdfa8daf63c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.159540 Jun 20 11:14:09.319474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 361/714] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:09 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:09.793421 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:09.794141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:09.800489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.800934 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.801690 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.802141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.960126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:09.968619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e56d28d-f7ad-44cb-8cbc-4c3a154d6655 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1455 microversion: 2.1 time: 0.179543 Jun 20 11:14:09.969225 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 354/715] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:09 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1455 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:09.985211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:09.985822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:09.994224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.995148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:09.996766 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:09.997462 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:10.159820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:10.168003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f2d7d4a0-1a9e-4e68-9277-9e79ffd23ac9 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1455 microversion: 2.1 time: 0.186675 Jun 20 11:14:10.168815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 362/716] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:09 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1455 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:10.337129 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:10.337730 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:10.345026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:10.345484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:10.346344 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:10.346798 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:10.489942 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:10.498050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b1880ed4-1b4e-463f-98ec-6c9daaa7a60c tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.164851 Jun 20 11:14:10.498748 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 355/717] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:10 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:11.517569 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:11.518519 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:11.527630 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:11.528237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:11.529025 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:11.529453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:11.760762 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:11.770702 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-44e11676-430f-4d04-973d-6d64ba81791d tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1567 microversion: 2.1 time: 0.257179 Jun 20 11:14:11.771274 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 363/718] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:11 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:12.049095 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-98461204-bc76-42e9-91af-844586f12e65 req-1e645611-ecf2-45ee-9850-33c8303d6e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a914d5-de24-456e-8214-b1aea3be01d3", "tag": "c7f3de09-c75f-445f-98c5-4dbaae29e1be"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:12.061163 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-98461204-bc76-42e9-91af-844586f12e65 req-1e645611-ecf2-45ee-9850-33c8303d6e31 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.061762 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-98461204-bc76-42e9-91af-844586f12e65 req-1e645611-ecf2-45ee-9850-33c8303d6e31 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.074519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-98461204-bc76-42e9-91af-844586f12e65 req-1e645611-ecf2-45ee-9850-33c8303d6e31 service nova] Creating event network-changed:c7f3de09-c75f-445f-98c5-4dbaae29e1be for instance 49a914d5-de24-456e-8214-b1aea3be01d3 on hv-cinder-84614 Jun 20 11:14:12.079684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-98461204-bc76-42e9-91af-844586f12e65 req-1e645611-ecf2-45ee-9850-33c8303d6e31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034353 Jun 20 11:14:12.080405 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 356/719] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:12.274833 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:12.276047 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:12.282735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.283280 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.284197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.284706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.318016 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-db655d5e-adcf-4ed5-a0c5-196f97f0dc9c tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Jun 20 11:14:12.318939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 364/720] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:14:12 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:14:12.329633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:12.330501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:12.337355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.338041 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.338833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.339474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.380175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-09a31127-5e41-4d7b-890d-d5e7802a88bd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/e69bb300-2c6a-45a2-baeb-332befe50f2d" status: 200 len: 194 microversion: 2.1 time: 0.054873 Jun 20 11:14:12.380880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 357/721] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jun 20 11:14:12 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/e69bb300-2c6a-45a2-baeb-332befe50f2d => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:12.471109 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-e6cc360a-c008-4703-b701-2b2901255ab5 req-46a341bb-fbc1-4d02-afcd-8c5aa4595ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f32e69e7-1865-492a-8571-a7f975792a16", "name": "network-vif-deleted", "tag": "266dcdbc-c0cd-479c-810c-92b547f78829"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:12.480151 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e6cc360a-c008-4703-b701-2b2901255ab5 req-46a341bb-fbc1-4d02-afcd-8c5aa4595ee2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.480603 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e6cc360a-c008-4703-b701-2b2901255ab5 req-46a341bb-fbc1-4d02-afcd-8c5aa4595ee2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.494481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-e6cc360a-c008-4703-b701-2b2901255ab5 req-46a341bb-fbc1-4d02-afcd-8c5aa4595ee2 service nova] Creating event network-vif-deleted:266dcdbc-c0cd-479c-810c-92b547f78829 for instance f32e69e7-1865-492a-8571-a7f975792a16 on hv-cinder-84614 Jun 20 11:14:12.504500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-e6cc360a-c008-4703-b701-2b2901255ab5 req-46a341bb-fbc1-4d02-afcd-8c5aa4595ee2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035615 Jun 20 11:14:12.508586 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 365/722] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:12.791208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:12.791811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:12.800433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.801329 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.803370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:12.804198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:12.934538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdff9a743af948f88d60a6fd80795c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51c3f69c523b49e68d7d4d09f3236c4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:12.946697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f6a915e-3f91-4492-b901-981a5b9fc302 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 200 len: 1217 microversion: 2.1 time: 0.161694 Jun 20 11:14:12.947636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 358/723] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:12 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:13.897761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6efbd891-4517-4aee-b65f-affff64c87b6"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:13.898947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:13.907243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:13.908014 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:13.909019 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:13.909542 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:13.963732 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:13.964401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] [instance: f32e69e7-1865-492a-8571-a7f975792a16] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:13.971499 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:13.971943 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:13.972702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:13.973124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:13.987611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] HTTP exception thrown: Instance f32e69e7-1865-492a-8571-a7f975792a16 could not be found. Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Request method failure captured: Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 HTTP/1.1 Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFT1IZEMp5q8dGf-yEz332AnARwXW5phhutFyqtNdHOhuawPgR-PGFToGcXWy8esGoaPHEKCUQEHKucCqNhXe_jOFz6PoenXsR7o_EoIL3SF6aIMtg3tabz0Tdg9jrdo0cFIH64_55fVADt9kaye7GjcIbNID5z85BnUhgkjQMlUPFw Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 51c3f69c523b49e68d7d4d09f3236c4e Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestShelveInstance-1228232773 Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:14:13.989262 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_51c3f69c523b49e68d7d4d09f3236c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/51c3f69c523b49e68d7d4d09f3236c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/51c3f69c523b49e68d7d4d09f3236c4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/51c3f69c523b49e68d7d4d09f3236c4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestShelveInstance-1228232773 Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 51c3f69c523b49e68d7d4d09f3236c4e Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestShelveInstance-1228232773 Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-TestShelveInstance-1228232773-project Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fdff9a743af948f88d60a6fd80795c06 Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestShelveInstance-1228232773-project Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance f32e69e7-1865-492a-8571-a7f975792a16 could not be found. Jun 20 11:14:13.990699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'f32e69e7-1865-492a-8571-a7f975792a16'} Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f32e69e7-1865-492a-8571-a7f975792a16 could not be found. Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:13.991557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f32e69e7-1865-492a-8571-a7f975792a16 could not be found. Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f32e69e7-1865-492a-8571-a7f975792a16 could not be found. Jun 20 11:14:13.992897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:13.994080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Returning 404 to user: Instance f32e69e7-1865-492a-8571-a7f975792a16 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:13.994080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-002541c7-62b1-4c01-81ae-def6c9c2b76a tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16" status: 404 len: 111 microversion: 2.1 time: 0.030903 Jun 20 11:14:13.994080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 359/724] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:13 2022] GET /compute/v2.1/servers/f32e69e7-1865-492a-8571-a7f975792a16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:14.172891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7d0ff790-3ace-4715-9acd-3a928d312a81 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] Calling method '.version_select at 0x7f7215a44e50>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:14.192898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-649c404d-77d4-4927-908e-267e4d8621bc tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "POST /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299825 Jun 20 11:14:14.194264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 366/725] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:14:13 2022] POST /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:14.197346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7d0ff790-3ace-4715-9acd-3a928d312a81 tempest-TestShelveInstance-1228232773 tempest-TestShelveInstance-1228232773-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-797202121" status: 202 len: 0 microversion: 2.1 time: 0.028636 Jun 20 11:14:14.198432 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 360/726] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-797202121 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:14:21.819872 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:21.821148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:21.828526 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:21.829088 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:21.829853 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:21.830319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:21.864986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bf8f79dc-0381-490d-9053-32bfb98fb546 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049443 Jun 20 11:14:21.865714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 367/727] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:14:21 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:22.013222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:22.013810 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:22.020543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:22.021013 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:22.021788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:22.022255 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:22.055971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a5ee82de-64d1-4089-ba4c-71870e8e3688 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/e69bb300-2c6a-45a2-baeb-332befe50f2d" status: 200 len: 194 microversion: 2.1 time: 0.047766 Jun 20 11:14:22.056617 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 361/728] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jun 20 11:14:22 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/e69bb300-2c6a-45a2-baeb-332befe50f2d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:22.067384 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:22.067886 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:22.075328 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:22.075774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:22.076542 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:22.076977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:22.081574 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:22.397641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lazy-loading 'services' on Instance uuid 1a57fac4-93ed-4e53-b5b3-d18a1834707b {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:14:22.478974 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5568c43c-2391-467c-b790-691a347ad685 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/e69bb300-2c6a-45a2-baeb-332befe50f2d" status: 202 len: 0 microversion: 2.1 time: 0.415600 Jun 20 11:14:22.479945 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 368/729] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:14:22 2022] DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/e69bb300-2c6a-45a2-baeb-332befe50f2d => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:14:24.654836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:24.655404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:24.662546 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:24.663000 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:24.663782 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:24.664228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:24.695021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-13c09c11-522b-44ae-b06d-7bcb7482dadd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/6efbd891-4517-4aee-b65f-affff64c87b6" status: 200 len: 194 microversion: 2.1 time: 0.044247 Jun 20 11:14:24.695594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 362/730] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jun 20 11:14:24 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/6efbd891-4517-4aee-b65f-affff64c87b6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:24.706803 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:24.707424 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:24.715027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:24.715476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:24.716255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:24.716689 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:24.801933 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lazy-loading 'services' on Instance uuid 1a57fac4-93ed-4e53-b5b3-d18a1834707b {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:14:24.877139 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-440a22ce-c189-4d1c-9f3d-293c275394b3 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/6efbd891-4517-4aee-b65f-affff64c87b6" status: 202 len: 0 microversion: 2.1 time: 0.174644 Jun 20 11:14:24.877731 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 369/731] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:14:24 2022] DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments/6efbd891-4517-4aee-b65f-affff64c87b6 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:14:26.066970 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:26.067908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:26.077180 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.077649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.078558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.078990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.113691 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-644c4ccd-dfe9-49fe-af0a-998dba79a4e7 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050615 Jun 20 11:14:26.114441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 363/732] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:14:26 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:14:26.241234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:26.242444 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:26.249966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.250571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.251479 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.251989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.284377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-624f19b4-4f2c-4484-a89b-79776e0668ad tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048012 Jun 20 11:14:26.284953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 370/733] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:14:26 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:14:26.351053 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:26.351552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:26.359028 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.360752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.361541 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.361971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.391753 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:14:26.486786 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-135b085b-af5e-46c4-8045-960b5a8cac58 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 204 len: 0 microversion: 2.1 time: 0.139354 Jun 20 11:14:26.487392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 364/734] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:14:26 2022] DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:14:26.497764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:26.499198 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:26.507235 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.507969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.509359 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:26.510065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:26.665330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:26.673625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-966b699d-caa9-44dc-88b0-e3c9df747c4b tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1672 microversion: 2.1 time: 0.180747 Jun 20 11:14:26.674235 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 371/735] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:26 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:27.696822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:27.697909 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:27.705135 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:27.705588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:27.706391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:27.706829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:27.956689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:27.966944 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-622fa6e0-28f6-43c8-9d4e-c0715f022bfa tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1672 microversion: 2.1 time: 0.277215 Jun 20 11:14:27.967622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 365/736] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:27 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1672 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:28.985312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:28.986019 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:28.993746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:28.994243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:28.995041 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:28.995707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:29.136629 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:29.145044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-de24d6b0-da97-4758-a547-41428a393ff2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1672 microversion: 2.1 time: 0.163633 Jun 20 11:14:29.145636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 372/737] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:28 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:29.189222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:29.189816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:29.197184 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:29.197638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:29.198697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:29.199335 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:29.225714 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b4351406-b356-4753-b9d0-d9e012e489c5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/ips" status: 200 len: 153 microversion: 2.20 time: 0.040788 Jun 20 11:14:29.226679 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 366/738] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jun 20 11:14:29 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 11:14:30.106039 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a9ab1052-88f6-4790-90a6-07e267cbcc32 req-fa409ca7-4f64-40b2-8082-8eeed00acd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a57fac4-93ed-4e53-b5b3-d18a1834707b", "name": "network-vif-deleted", "tag": "85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:30.116007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a9ab1052-88f6-4790-90a6-07e267cbcc32 req-fa409ca7-4f64-40b2-8082-8eeed00acd52 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:30.116447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a9ab1052-88f6-4790-90a6-07e267cbcc32 req-fa409ca7-4f64-40b2-8082-8eeed00acd52 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:30.128290 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a9ab1052-88f6-4790-90a6-07e267cbcc32 req-fa409ca7-4f64-40b2-8082-8eeed00acd52 service nova] Creating event network-vif-deleted:85b83056-86ab-4d9f-b1f5-9f7b61bd2dd5 for instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b on hv-cinder-84614 Jun 20 11:14:30.133285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a9ab1052-88f6-4790-90a6-07e267cbcc32 req-fa409ca7-4f64-40b2-8082-8eeed00acd52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Jun 20 11:14:30.133860 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 373/739] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:30.167026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:30.168426 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:30.174781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:30.175570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:30.176464 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:30.176988 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:30.181620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:30.259680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e77af2b3a2409fa6d352b0d2674b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eb9dd7f67cb48cebba2dabcd32a21d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:30.269237 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c5045e8b-e6f4-40ca-9fc2-fa99f9a72e49 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 200 len: 1605 microversion: 2.1 time: 0.106154 Jun 20 11:14:30.270202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 367/740] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:30 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:14:31.288356 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:31.289033 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:31.296188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:31.296644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:31.297490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:31.297948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:31.314458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] HTTP exception thrown: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Request method failure captured: Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b HTTP/1.1 Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ9MAV1ZUI9p1JtoWUQkhTS_yo16_GshqC2QGYCjkzRxl1MzVmBMNgXTsURvIo0a0xmWX4P98yQqVHqRgJszQSHAXQtd8NR9keAbDkbl77U3upnU7GXPgYONNLtNwLOkDpumFTHJmExOEP8gvYQdMFxejq-Up4hSq2fsjT2iKdGq5M Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:14:31.316418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 48e77af2b3a2409fa6d352b0d2674b85 Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:31.318071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '1a57fac4-93ed-4e53-b5b3-d18a1834707b'} Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:31.319809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:31.322119 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:31.324634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Returning 404 to user: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:31.324634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9c26d6f0-74e3-47b0-8830-3cf507be2400 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 404 len: 111 microversion: 2.1 time: 0.034358 Jun 20 11:14:31.324634 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 374/741] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:31 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:31.328864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-20eab488-24d9-4b4d-b636-ad44f1869cbd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '.version_select at 0x7f7215a6ce50>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:31.350349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-20eab488-24d9-4b4d-b636-ad44f1869cbd tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555853467" status: 202 len: 0 microversion: 2.1 time: 0.026436 Jun 20 11:14:31.350943 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 368/742] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 20 11:14:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555853467 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:14:31.634613 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:31.635142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:31.641670 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:31.642234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:31.642903 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:31.643334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:31.832796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lazy-loading 'flavor' on Instance uuid 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:14:32.179733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-44401dbf-2736-463b-92b6-49cf533629bb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/action" status: 202 len: 0 microversion: 2.20 time: 0.549151 Jun 20 11:14:32.180593 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 375/743] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 20 11:14:31 2022] POST /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:14:32.192566 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:32.193446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:32.202886 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:32.203588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:32.205070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:32.205825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:32.364579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:32.373447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:32.375032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:32.376226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b9cc1d24-7e2d-4576-b34c-44efd87fc07b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.190216 Jun 20 11:14:32.376766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 369/744] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:32 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:33.397555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:33.398559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:33.406683 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:33.407130 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:33.407904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:33.408335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:33.550228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:33.559243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:33.561181 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:33.562472 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-12d13715-bd4c-4fe0-ab3e-c5b4428bad0a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.170276 Jun 20 11:14:33.563038 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 376/745] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:33 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:34.337186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:34.337747 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:34.345538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:34.345983 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:34.346861 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:34.347293 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:34.361800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] HTTP exception thrown: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Request method failure captured: Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b HTTP/1.1 Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ9MAV1ZUI9p1JtoWUQkhTS_yo16_GshqC2QGYCjkzRxl1MzVmBMNgXTsURvIo0a0xmWX4P98yQqVHqRgJszQSHAXQtd8NR9keAbDkbl77U3upnU7GXPgYONNLtNwLOkDpumFTHJmExOEP8gvYQdMFxejq-Up4hSq2fsjT2iKdGq5M Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:14:34.365279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 48e77af2b3a2409fa6d352b0d2674b85 Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.367389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '1a57fac4-93ed-4e53-b5b3-d18a1834707b'} Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:34.368611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.370697 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.372358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Returning 404 to user: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:34.372358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ad394ef6-d955-4cf2-a818-78452bd964cb tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 404 len: 111 microversion: 2.1 time: 0.031644 Jun 20 11:14:34.372358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 370/746] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:14:34 2022] DELETE /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:34.382770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:34.383454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: 1a57fac4-93ed-4e53-b5b3-d18a1834707b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:34.390449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:34.390898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:34.391649 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:34.392071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:34.406956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] HTTP exception thrown: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Request method failure captured: Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b HTTP/1.1 Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ9MAV1ZUI9p1JtoWUQkhTS_yo16_GshqC2QGYCjkzRxl1MzVmBMNgXTsURvIo0a0xmWX4P98yQqVHqRgJszQSHAXQtd8NR9keAbDkbl77U3upnU7GXPgYONNLtNwLOkDpumFTHJmExOEP8gvYQdMFxejq-Up4hSq2fsjT2iKdGq5M Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:14:34.408614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 48e77af2b3a2409fa6d352b0d2674b85 Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.410176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '1a57fac4-93ed-4e53-b5b3-d18a1834707b'} Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:34.411144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. Jun 20 11:14:34.412559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:34.413842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Returning 404 to user: Instance 1a57fac4-93ed-4e53-b5b3-d18a1834707b could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:34.413842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b6e2a35-ee49-4b61-a57b-8c343f73bb10 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b" status: 404 len: 111 microversion: 2.1 time: 0.031163 Jun 20 11:14:34.413842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 377/747] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:34 2022] GET /compute/v2.1/servers/1a57fac4-93ed-4e53-b5b3-d18a1834707b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:34.582136 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:34.582637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:34.589330 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:34.590108 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:34.590890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:34.591321 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:34.730876 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:34.739584 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:34.741070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:34.742285 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fbfaf226-46db-4701-8075-909d8a59809d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.164211 Jun 20 11:14:34.742866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 371/748] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:34 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:35.552572 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:35.553150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:35.555582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=42 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:35.561827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:35.562308 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:35.563081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:35.563514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:35.578122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] HTTP exception thrown: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Request method failure captured: Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d HTTP/1.1 Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFQ9MAV1ZUI9p1JtoWUQkhTS_yo16_GshqC2QGYCjkzRxl1MzVmBMNgXTsURvIo0a0xmWX4P98yQqVHqRgJszQSHAXQtd8NR9keAbDkbl77U3upnU7GXPgYONNLtNwLOkDpumFTHJmExOEP8gvYQdMFxejq-Up4hSq2fsjT2iKdGq5M Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:14:35.579713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 48e77af2b3a2409fa6d352b0d2674b85 Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.581300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'fe316d92-1158-4b44-b5c6-1c7c37e4c10d'} Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:35.582004 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.583327 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.584515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Returning 404 to user: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:35.584515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a5f9b426-408f-4b43-98aa-7a1e227082f2 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 404 len: 111 microversion: 2.1 time: 0.032679 Jun 20 11:14:35.584515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 378/749] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:14:35 2022] DELETE /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:35.590007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:35.590660 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] [instance: fe316d92-1158-4b44-b5c6-1c7c37e4c10d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:35.597404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:35.597853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:35.598662 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:35.599093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:35.612670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] HTTP exception thrown: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Request method failure captured: Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d HTTP/1.1 Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFQ9MAV1ZUI9p1JtoWUQkhTS_yo16_GshqC2QGYCjkzRxl1MzVmBMNgXTsURvIo0a0xmWX4P98yQqVHqRgJszQSHAXQtd8NR9keAbDkbl77U3upnU7GXPgYONNLtNwLOkDpumFTHJmExOEP8gvYQdMFxejq-Up4hSq2fsjT2iKdGq5M Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:14:35.614242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7eb9dd7f67cb48cebba2dabcd32a21d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 7eb9dd7f67cb48cebba2dabcd32a21d7 Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1257031091 Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 48e77af2b3a2409fa6d352b0d2674b85 Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeTestJSON-1257031091-project Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.615677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'fe316d92-1158-4b44-b5c6-1c7c37e4c10d'} Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:35.620173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. Jun 20 11:14:35.621636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:35.623012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] Returning 404 to user: Instance fe316d92-1158-4b44-b5c6-1c7c37e4c10d could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:35.623012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e19127a-2bc0-4c92-8017-4b2560219c17 tempest-AttachVolumeTestJSON-1257031091 tempest-AttachVolumeTestJSON-1257031091-project] 10.222.0.33 "GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d" status: 404 len: 111 microversion: 2.1 time: 0.029589 Jun 20 11:14:35.623012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 372/750] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:14:35 2022] GET /compute/v2.1/servers/fe316d92-1158-4b44-b5c6-1c7c37e4c10d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:35.761494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:35.762329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:35.769533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:35.769986 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:35.770882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:35.771323 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:35.907471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:35.915018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:35.916616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:35.917963 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-88eeb01b-8b45-4f0d-ba71-e689229a2858 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.160850 Jun 20 11:14:35.918630 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 379/751] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:35 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:36.937182 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:36.937800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:36.940303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:36.945763 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:36.946275 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:36.947096 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:36.947508 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:37.146245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:37.155561 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:37.157139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:37.158407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-45963ebf-5f2c-4ad2-aade-4f533768ac22 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.225891 Jun 20 11:14:37.159048 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 373/752] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:36 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:38.177274 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:38.177879 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:38.185402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:38.185857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:38.186641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:38.187076 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:38.327617 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:38.338512 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:38.340177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:38.341370 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8805ca96-34d0-4155-8086-fc49c39ef9a1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.168281 Jun 20 11:14:38.341922 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 380/753] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:38 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:39.359642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:39.360954 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:39.379057 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:39.379515 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:39.380317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:39.380757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:39.550536 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:39.565006 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:39.567294 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:39.568489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-dd1ebc12-e5cf-40ac-83e1-0d7e6fa5a978 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.212941 Jun 20 11:14:39.577081 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 374/754] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:39 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:14:40.454523 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-83295cdc-2b79-413d-bf0a-6030d31e4f83 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Action: 'create', calling method: .version_select at 0x7f721502db80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1130360199"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:40.587394 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:40.587981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:40.594778 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:40.595224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:40.595991 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:40.596386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:40.739324 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:40.748540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:40.750351 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:40.751667 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a552bbd-64a8-4682-b558-c9dbf2e27b1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.168245 Jun 20 11:14:40.752556 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 375/755] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:40 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:40.766284 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-83295cdc-2b79-413d-bf0a-6030d31e4f83 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.437116 Jun 20 11:14:40.773728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 381/756] 10.222.0.33 () {60 vars in 1154 bytes} [Mon Jun 20 11:14:40 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 11:14:40.779430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4bd31715-3087-4982-817d-aa212c2cadd6 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215a449d0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:40.828636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4bd31715-3087-4982-817d-aa212c2cadd6 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 200 len: 345 microversion: 2.1 time: 0.053333 Jun 20 11:14:40.829222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 376/757] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:14:40 2022] GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:41.771374 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:41.772134 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:41.783438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:41.784124 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:41.785314 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:41.785989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:41.843156 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1a6f1e8f-1dc1-40b7-ad8c-cf1069432c07 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215a37040>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:41.892960 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1a6f1e8f-1dc1-40b7-ad8c-cf1069432c07 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 200 len: 346 microversion: 2.1 time: 0.055803 Jun 20 11:14:41.893610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 377/758] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:14:41 2022] GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:14:41.905497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f9329829-8f11-459f-ac3e-89afe76e84a4 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Action: 'create', calling method: .version_select at 0x7f7215b00160>, body: {"snapshot": {"volume_id": "87567b8f-4f3b-410b-80d5-60d63bac7cab", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1838080021"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:41.939038 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:41.947448 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:41.949148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:41.950501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-02485f24-f7f9-4eb1-aa7b-7d5010726ebe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.184399 Jun 20 11:14:41.951058 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 382/759] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:41 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:42.073512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f9329829-8f11-459f-ac3e-89afe76e84a4 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.172302 Jun 20 11:14:42.074226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 378/760] 10.222.0.33 () {60 vars in 1161 bytes} [Mon Jun 20 11:14:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:42.085005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-644b7e15-e071-478d-bf33-1f7528d92372 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f72150f6820>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:42.118665 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-644b7e15-e071-478d-bf33-1f7528d92372 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.037872 Jun 20 11:14:42.119326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 383/761] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:42 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:42.130813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b63c05eb-0ac5-4ffa-b7bf-9ec1250c8aab tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215a44280>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:42.161296 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b63c05eb-0ac5-4ffa-b7bf-9ec1250c8aab tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034324 Jun 20 11:14:42.161891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 379/762] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jun 20 11:14:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:42.173168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-008571a0-4de3-43f2-96c4-a3031c034cf0 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f72150f6040>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:42.203599 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-008571a0-4de3-43f2-96c4-a3031c034cf0 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.034200 Jun 20 11:14:42.204287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 384/763] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:42 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:42.611227 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:14:42.611513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:14:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:14:42.973036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:42.973614 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:42.982290 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:42.982735 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:42.983523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:42.983951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:43.132109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:43.141655 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:43.143158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:43.144376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-003771ad-4414-45f3-b0f7-fd4cf5b973af tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.178813 Jun 20 11:14:43.144945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 380/764] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:42 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:43.216370 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-14d15b01-b852-425e-b72f-10cd34ed70f0 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215065550>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:43.248457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-14d15b01-b852-425e-b72f-10cd34ed70f0 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.037077 Jun 20 11:14:43.249012 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 385/765] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:43 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:44.163936 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:44.164547 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:44.173572 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:44.173950 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:44.174767 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:44.175204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:44.260258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1927e8b1-45c2-412e-b931-6910ad919129 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f72150f6b80>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:44.292237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1927e8b1-45c2-412e-b931-6910ad919129 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.036217 Jun 20 11:14:44.293082 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 386/766] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:44 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:44.319669 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:44.330592 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:44.332799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:44.334597 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8789bf9e-0c65-4bcf-8d28-166617da47ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.174393 Jun 20 11:14:44.335373 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 381/767] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:44 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:45.305352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6a3ef137-289e-4607-b204-d8a5f3460438 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721510f790>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:45.336805 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6a3ef137-289e-4607-b204-d8a5f3460438 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.035761 Jun 20 11:14:45.337400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 387/768] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:45 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:45.353412 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:45.353993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:45.361412 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:45.361862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:45.362675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:45.363106 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:45.518746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:45.527202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:45.528721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:45.529901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f697b929-a995-4ab8-81e1-2362fc28c4ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.180549 Jun 20 11:14:45.530501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 382/769] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:45 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:46.355325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e6d8054a-7eba-4c41-99ad-70e26984bfb5 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721510daf0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:46.393338 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e6d8054a-7eba-4c41-99ad-70e26984bfb5 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.045977 Jun 20 11:14:46.393887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 388/770] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:46 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:46.551459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:46.552042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:46.559470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:46.559927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:46.560692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:46.561205 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:46.711649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:46.719888 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:46.721374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:46.722567 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3d470a0a-0f04-4b56-bf63-e259f45c5f88 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.175112 Jun 20 11:14:46.723129 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 383/771] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:46 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:47.406297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b61deca5-f680-4976-909e-9ccea2e5b54d tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721510f040>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:47.438271 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b61deca5-f680-4976-909e-9ccea2e5b54d tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.036234 Jun 20 11:14:47.438849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 389/772] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:47 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:47.745833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:47.746449 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:47.753576 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:47.754021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:47.754853 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:47.755279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:47.895698 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:47.906499 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:47.908027 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:47.909275 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c52c149b-a43e-47f0-b81d-08baa5282176 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.168316 Jun 20 11:14:47.910473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 384/773] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:47 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:48.453621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f45f0fa4-01b5-43a8-a430-f4cc320c857f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721506fca0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:48.490271 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f45f0fa4-01b5-43a8-a430-f4cc320c857f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 288 microversion: 2.1 time: 0.042917 Jun 20 11:14:48.490832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 390/774] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:48 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:48.502250 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c0cb59f0-ecdc-4757-9cce-47ab8abc2cba tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215a16430>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:48.566974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c0cb59f0-ecdc-4757-9cce-47ab8abc2cba tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 202 len: 0 microversion: 2.1 time: 0.068957 Jun 20 11:14:48.567558 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 385/775] 10.222.0.33 () {58 vars in 1253 bytes} [Mon Jun 20 11:14:48 2022] DELETE /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:14:48.576295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9bcabe47-6dad-43ad-b96b-602e6982a687 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721510d5e0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:48.607149 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9bcabe47-6dad-43ad-b96b-602e6982a687 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 200 len: 287 microversion: 2.1 time: 0.034559 Jun 20 11:14:48.607701 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 391/776] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:48 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:48.930890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:48.931479 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:48.938983 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:48.939438 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:48.940217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:48.940656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:49.087908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:49.096304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:49.097787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:49.098974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ff8dd28-4981-47ec-84b6-48fa9f735781 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1744 microversion: 2.20 time: 0.172626 Jun 20 11:14:49.099533 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 386/777] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:48 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:49.621330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc2cadbb-449f-4f2d-b0f6-d1a37e09c94f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721510f3a0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:49.648250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-cc2cadbb-449f-4f2d-b0f6-d1a37e09c94f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] HTTP exception thrown: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc2cadbb-449f-4f2d-b0f6-d1a37e09c94f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Request method failure captured: Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb HTTP/1.1 Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFagCLUU-aYSnIWLFBAEQxSKit6FPxadhZ7OjufDm8VTPDyFZYGDWd1jF7y3ak9GAoucAfPoldNYAii1oMhcutecj66SO_LYkCtfHQhCImmcyQy0sgaIGZzlLm2_QW6F2JslC38qRtifReKxTaicpQbndnCQh54wSthD4wGybnHJsoQ Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:14:49.650537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 1a75665a44c049ce8d218c9c81024567 Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '7962344e-446a-4595-920b-8f2f6d3b02cb'} Jun 20 11:14:49.652101 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. (HTTP 404) (Request-ID: req-8e58890a-d2e4-40a8-bea6-3a32ce6a695b) Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.653000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:14:49.654125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 11:14:49.655254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc2cadbb-449f-4f2d-b0f6-d1a37e09c94f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Returning 404 to user: Snapshot 7962344e-446a-4595-920b-8f2f6d3b02cb could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cc2cadbb-449f-4f2d-b0f6-d1a37e09c94f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb" status: 404 len: 111 microversion: 2.1 time: 0.035313 Jun 20 11:14:49.656742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 392/778] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 20 11:14:49 2022] GET /compute/v2.1/os-snapshots/7962344e-446a-4595-920b-8f2f6d3b02cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:49.661168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00f88c55-b001-4b6e-af6c-9ba92637899f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215a165e0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:49.724526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00f88c55-b001-4b6e-af6c-9ba92637899f tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 202 len: 0 microversion: 2.1 time: 0.067160 Jun 20 11:14:49.725099 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 387/779] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:14:49 2022] DELETE /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:14:49.735194 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-98c0cc3a-b781-491f-884e-89db9491ee37 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721510d0d0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:49.785609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-98c0cc3a-b781-491f-884e-89db9491ee37 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 200 len: 345 microversion: 2.1 time: 0.055249 Jun 20 11:14:49.786364 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 393/780] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:14:49 2022] GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:50.118710 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:50.119419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:50.126617 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:50.127057 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:50.127824 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:50.128253 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:50.272758 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:50.281185 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:50.283446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:50.284615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5156e800-914a-4a1c-844d-dcf6160edcfc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1744 microversion: 2.20 time: 0.170444 Jun 20 11:14:50.285170 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 388/781] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:50 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:14:50.801505 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-800aa1bb-1b11-4de9-918e-790733eccc6c tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f721506ff70>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:50.836343 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-800aa1bb-1b11-4de9-918e-790733eccc6c tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] HTTP exception thrown: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-800aa1bb-1b11-4de9-918e-790733eccc6c tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Request method failure captured: Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab HTTP/1.1 Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFagCLUU-aYSnIWLFBAEQxSKit6FPxadhZ7OjufDm8VTPDyFZYGDWd1jF7y3ak9GAoucAfPoldNYAii1oMhcutecj66SO_LYkCtfHQhCImmcyQy0sgaIGZzlLm2_QW6F2JslC38qRtifReKxTaicpQbndnCQh54wSthD4wGybnHJsoQ Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:14:50.838346 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 1a75665a44c049ce8d218c9c81024567 Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '87567b8f-4f3b-410b-80d5-60d63bac7cab'} Jun 20 11:14:50.839748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. (HTTP 404) (Request-ID: req-a68610cb-bb63-4d0a-b593-cfd50af38280) Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.840624 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:14:50.841732 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 11:14:50.842868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-800aa1bb-1b11-4de9-918e-790733eccc6c tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Returning 404 to user: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-800aa1bb-1b11-4de9-918e-790733eccc6c tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 404 len: 109 microversion: 2.1 time: 0.043669 Jun 20 11:14:50.844267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 394/782] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:14:50 2022] GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:50.855198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b606af5-6488-4598-909f-56e4ffe35572 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215a6c160>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:50.886304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-2b606af5-6488-4598-909f-56e4ffe35572 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] HTTP exception thrown: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b606af5-6488-4598-909f-56e4ffe35572 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Request method failure captured: Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab HTTP/1.1 Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFagCLUU-aYSnIWLFBAEQxSKit6FPxadhZ7OjufDm8VTPDyFZYGDWd1jF7y3ak9GAoucAfPoldNYAii1oMhcutecj66SO_LYkCtfHQhCImmcyQy0sgaIGZzlLm2_QW6F2JslC38qRtifReKxTaicpQbndnCQh54wSthD4wGybnHJsoQ Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:14:50.889613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 1a75665a44c049ce8d218c9c81024567 Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '87567b8f-4f3b-410b-80d5-60d63bac7cab'} Jun 20 11:14:50.891014 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. (HTTP 404) (Request-ID: req-1cbebde2-c3ce-4027-948b-c2d9ad0e51a8) Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.891855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 11:14:50.893119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 11:14:50.894520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2b606af5-6488-4598-909f-56e4ffe35572 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Returning 404 to user: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2b606af5-6488-4598-909f-56e4ffe35572 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 404 len: 109 microversion: 2.1 time: 0.040107 Jun 20 11:14:50.895843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 389/783] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:14:50 2022] DELETE /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:50.899859 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f5251a4-ffae-49d3-b41a-ed2098502c18 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Calling method '.version_select at 0x7f7215030040>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:50.933144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-7f5251a4-ffae-49d3-b41a-ed2098502c18 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] HTTP exception thrown: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f5251a4-ffae-49d3-b41a-ed2098502c18 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Request method failure captured: Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab HTTP/1.1 Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFagCLUU-aYSnIWLFBAEQxSKit6FPxadhZ7OjufDm8VTPDyFZYGDWd1jF7y3ak9GAoucAfPoldNYAii1oMhcutecj66SO_LYkCtfHQhCImmcyQy0sgaIGZzlLm2_QW6F2JslC38qRtifReKxTaicpQbndnCQh54wSthD4wGybnHJsoQ Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:14:50.935487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/62c73564fd214b0381afbc25ac63e4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 62c73564fd214b0381afbc25ac63e4d9 Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-889218153 Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 1a75665a44c049ce8d218c9c81024567 Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-889218153-project Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '87567b8f-4f3b-410b-80d5-60d63bac7cab'} Jun 20 11:14:50.936984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. (HTTP 404) (Request-ID: req-9a57254f-c032-4cd4-bf81-ae539df30ced) Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.941411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:14:50.943079 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 11:14:50.944408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f5251a4-ffae-49d3-b41a-ed2098502c18 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] Returning 404 to user: Volume 87567b8f-4f3b-410b-80d5-60d63bac7cab could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7f5251a4-ffae-49d3-b41a-ed2098502c18 tempest-VolumesSnapshotsTestJSON-889218153 tempest-VolumesSnapshotsTestJSON-889218153-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab" status: 404 len: 109 microversion: 2.1 time: 0.040941 Jun 20 11:14:50.945848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 395/784] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:14:50 2022] GET /compute/v2.1/os-volumes/87567b8f-4f3b-410b-80d5-60d63bac7cab => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:14:51.304556 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:51.305667 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:51.312636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:51.313111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:51.313922 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:51.314491 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:51.473726 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:51.483355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:51.485317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:51.486618 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-49015a4d-5e5d-427b-a734-2e5a1cc99f3c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1744 microversion: 2.20 time: 0.187672 Jun 20 11:14:51.487286 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 390/785] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:51 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:52.502282 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=7 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:52.503821 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:52.508068 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:52.508660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:52.517826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:52.518343 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:52.519169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:52.519663 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:52.673207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:52.682269 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:52.683763 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:52.685299 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9e77c7de-7d54-417a-989b-023bac237f64 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1744 microversion: 2.20 time: 0.184496 Jun 20 11:14:52.685854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 396/786] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:52 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:53.102212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-27719041-7966-4a45-9af0-fa2bdbe7e329 req-1764156c-ddbc-44cd-ae7e-ea85b5166331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "name": "network-vif-plugged", "status": "completed", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:14:53.117611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-27719041-7966-4a45-9af0-fa2bdbe7e329 req-1764156c-ddbc-44cd-ae7e-ea85b5166331 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:53.119249 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-27719041-7966-4a45-9af0-fa2bdbe7e329 req-1764156c-ddbc-44cd-ae7e-ea85b5166331 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:53.140279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-27719041-7966-4a45-9af0-fa2bdbe7e329 req-1764156c-ddbc-44cd-ae7e-ea85b5166331 service nova] Creating event network-vif-plugged:4865ebb8-bb27-4185-b60c-1808baf91968 for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 on hv-cinder-84614 Jun 20 11:14:53.151091 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-27719041-7966-4a45-9af0-fa2bdbe7e329 req-1764156c-ddbc-44cd-ae7e-ea85b5166331 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056263 Jun 20 11:14:53.152902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 391/787] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:14:53.706811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:53.707395 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:53.714529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:53.714971 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:53.715733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:53.716168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:53.881871 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:53.890388 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:53.891927 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:53.893093 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-771b2ad6-62af-4e13-8daa-33ac8dacc394 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1744 microversion: 2.20 time: 0.191965 Jun 20 11:14:53.893614 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 397/788] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:53 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:54.917518 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:54.919046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:54.929447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:54.930610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:54.932261 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:54.933841 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:55.089867 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:55.102234 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:55.103986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:55.105432 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ceb334c2-6d26-4ea8-b6e0-8ba556f72bc8 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.198027 Jun 20 11:14:55.106245 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 392/789] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:54 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:56.127652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:56.128425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:56.135421 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:56.136151 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:56.137204 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:56.138438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:56.327947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:56.340621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:56.345153 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:56.350050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0f6cf141-65a4-4305-afd9-c6c0acb4b3ce tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.229736 Jun 20 11:14:56.352156 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 398/790] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:56 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:57.371220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:57.372600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:57.380501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:57.381272 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:57.382280 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:57.382706 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:57.547918 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:57.550893 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=100 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:14:57.559250 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:57.560949 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:57.562464 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ffa8fa1a-d683-4dae-9554-4f989a992e5d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.195605 Jun 20 11:14:57.563509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 393/791] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:57 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:58.581504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:58.582514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:58.593818 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:58.594373 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:58.595160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:58.595588 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:58.736977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:58.745979 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:58.747461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:58.748842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3b9ec386-f9aa-4a6c-8223-eccfdc2f3de9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.171598 Jun 20 11:14:58.749626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 399/792] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:58 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:14:59.773774 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:14:59.774433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:14:59.784440 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:59.784440 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:59.785645 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:14:59.785645 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:14:59.954384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:59.963735 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:59.966132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:14:59.967693 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-237b1d0d-e342-4653-b869-0a4202e53abd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.200259 Jun 20 11:14:59.968751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 394/793] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:14:59 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:00.991628 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:00.992889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:00.999942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:01.000756 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:01.001429 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:01.001859 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:01.171431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:01.181615 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:01.183185 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:01.184923 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8f32fd35-6de9-4f9d-a8fe-0c0d19ff8b97 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.198636 Jun 20 11:15:01.185682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 400/794] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:00 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:02.207813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:02.209621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:02.226987 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:02.227566 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:02.228451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:02.229450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:02.411700 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:02.420641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:02.422318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:02.423622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1fedd48f-32a4-4330-8b29-d07e585a00ff tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.223232 Jun 20 11:15:02.424193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 395/795] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:02 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:03.447069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:03.447828 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:03.455284 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:03.455845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:03.456718 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:03.457200 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:03.637180 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:03.651529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:03.654611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:03.657005 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a1fbae34-55f3-47f8-a148-f5b683c0f48b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1739 microversion: 2.20 time: 0.215722 Jun 20 11:15:03.658306 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 401/796] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:03 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:04.676204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:04.676864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:04.684624 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:04.685069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:04.685859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:04.686333 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:04.903901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:04.915056 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:04.917037 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:04.918336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-641ef21b-f253-4af2-95c6-35f44c10c9f7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1721 microversion: 2.20 time: 0.246523 Jun 20 11:15:04.918896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 396/797] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:04 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:05.937539 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:05.938897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:05.946117 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:05.946601 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:05.947383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:05.947811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:06.086454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:06.095549 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:06.097097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:06.098362 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bce1ff23-377f-4ac5-acfe-9ff3e35e73e0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1721 microversion: 2.20 time: 0.165131 Jun 20 11:15:06.098914 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 402/798] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:05 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:07.116605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:07.117606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:07.120238 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:15:07.126419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:07.126902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:07.127745 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:07.128193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:07.323701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:07.335195 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:07.336716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:07.337923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5929e016-870b-4223-9139-2f5825d4782e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1724 microversion: 2.20 time: 0.225622 Jun 20 11:15:07.350466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 397/799] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:07 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:07.359585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bb8f5b1-8feb-41de-9871-6758112cfd66"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:15:07.361724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:07.377686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:07.377686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:07.377686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:07.377686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:07.806383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-53af9d8d-8f47-41d4-a337-1e08cb43ff19 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.453367 Jun 20 11:15:07.807042 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 403/800] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jun 20 11:15:07 2022] POST /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments => generated 188 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:15:07.943772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:15:07.944794 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:07.956707 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:07.957567 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:07.958881 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:07.959593 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:08.082470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-54c20aa0-f6b4-459c-b9da-0d093fb28230 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/action" status: 202 len: 0 microversion: 2.20 time: 0.146795 Jun 20 11:15:08.083431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 398/801] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 20 11:15:07 2022] POST /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:15:08.092589 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:08.094755 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:08.101695 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:08.102330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:08.103207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:08.103763 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:08.539144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:08.554663 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:08.557551 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:08.559133 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-63938ef0-59b6-4d75-b6eb-6cb7c6c58c7a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1750 microversion: 2.20 time: 0.470946 Jun 20 11:15:08.559697 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 404/802] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:08 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1750 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:09.142326 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-98116fdd-76a1-4419-b79d-807738907d01 req-8bae2621-23d9-4403-9dd1-1cfd37285f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "name": "network-vif-unplugged", "status": "completed", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:15:09.152169 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-98116fdd-76a1-4419-b79d-807738907d01 req-8bae2621-23d9-4403-9dd1-1cfd37285f73 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:09.153005 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-98116fdd-76a1-4419-b79d-807738907d01 req-8bae2621-23d9-4403-9dd1-1cfd37285f73 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:09.165911 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.compute.server_external_events [req-98116fdd-76a1-4419-b79d-807738907d01 req-8bae2621-23d9-4403-9dd1-1cfd37285f73 service nova] Unable to find a host for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4. Dropping event network-vif-unplugged {{(pid=117606) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 11:15:09.167032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-98116fdd-76a1-4419-b79d-807738907d01 req-8bae2621-23d9-4403-9dd1-1cfd37285f73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029127 Jun 20 11:15:09.167796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 399/803] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 11:15:09.578904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:09.579811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:09.593621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:09.608898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:09.611706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:09.612295 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:09.793478 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:09.804128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:09.806950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:09.808178 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3f7126b7-6a82-472c-8d2b-b0ce021eefde tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1752 microversion: 2.20 time: 0.233722 Jun 20 11:15:09.809096 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 405/804] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:09 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:10.828094 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:10.829028 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:10.836017 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:10.836474 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:10.837260 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:10.837692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:11.007894 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:11.017941 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:11.020643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:11.022425 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7f3e84aa-4769-4870-8a8c-226e2fe2b47f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.198293 Jun 20 11:15:11.023213 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 400/805] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:10 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:12.045427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:12.047087 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:12.056219 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:12.057057 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:12.058081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:12.058482 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:12.224299 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:12.234702 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:12.237129 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:12.239008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8c0c3a5c-a36a-42bd-bf0d-64f4fae25592 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.198585 Jun 20 11:15:12.239790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 406/806] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:12 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:13.264313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:13.265390 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:13.273809 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:13.274288 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:13.275070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:13.275505 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:13.423888 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:13.433024 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:13.434903 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:13.436075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-24e1c0cf-f643-4b7f-9a50-14580b798187 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.176154 Jun 20 11:15:13.436629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 401/807] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:13 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:15:14.456147 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:14.457127 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:14.465779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:14.466534 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:14.467340 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:14.467783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:14.613894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:14.622638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:14.624152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:14.625547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b7abcfb7-b85f-4df3-8cd4-b8cdf86ab4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.173973 Jun 20 11:15:14.626351 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 407/808] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:14 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:15.649502 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:15.652311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:15.664450 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:15.664927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:15.666268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:15.666993 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:15.819947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:15.829458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:15.830999 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:15.832219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-116599e5-4ad0-40e8-8abb-e04d192036cf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.190515 Jun 20 11:15:15.832763 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 402/809] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:15 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:16.851286 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:16.851912 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:16.858633 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:16.859075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:16.860498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:16.860936 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:17.018612 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:17.027577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:17.029069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:17.030270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7bb7383f-c0b4-48da-9b73-1ca1091c1c89 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.183179 Jun 20 11:15:17.030837 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 408/810] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:16 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:18.048941 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:18.050254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:18.057445 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:18.057996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:18.059393 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:18.059819 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:18.204972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:18.213988 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:18.215510 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:18.216708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0422a424-ee7a-45e7-a81f-d9d4713e6795 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.171963 Jun 20 11:15:18.217241 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 403/811] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:18 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:15:19.236311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:19.237827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:19.245229 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:19.245676 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:19.246548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:19.246984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:19.390508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:19.394570 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:15:19.400350 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:19.401887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:19.403085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46f37137-37ab-4e56-8949-66197c00675c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.170794 Jun 20 11:15:19.403846 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 409/812] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:19 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:20.424638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:20.425448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:20.442206 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:20.442865 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:20.444139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:20.444840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:20.614196 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:20.629150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:20.630781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:20.632057 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4ecbee56-4b5f-4f44-a4f2-0a7cd240e287 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.213072 Jun 20 11:15:20.634133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 404/813] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:20 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:21.651411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:21.652873 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:21.661818 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:21.662349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:21.663105 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:21.663540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:21.802830 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:21.812223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:21.813722 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:21.814913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-37ad8a60-a9a9-4f02-8517-0c8df2ba0ab5 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.167773 Jun 20 11:15:21.815559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 410/814] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:21 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:22.833791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:22.834373 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:22.841585 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:22.842048 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:22.842837 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:22.843268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:23.048919 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:23.060860 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:23.062388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:23.063597 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1feca82d-4964-435c-88c4-ec450ded025d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.234164 Jun 20 11:15:23.064380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 405/815] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:22 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:24.083166 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:24.084066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:24.086199 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=31 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:15:24.092467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:24.093003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:24.093836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:24.094414 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:24.244659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:24.253882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:24.255428 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:24.256601 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-97e1ad84-5957-4dfc-8329-62f75d93cb28 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.177541 Jun 20 11:15:24.257153 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 411/816] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:24 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:25.274880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:25.275480 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:25.282434 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:25.282880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:25.283643 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:25.284081 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:25.433190 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:25.443862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:25.445359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:25.446572 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-62084075-d783-412b-89d4-00fae144530c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.175804 Jun 20 11:15:25.447198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 406/817] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:25 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:26.466235 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:26.467673 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:26.475970 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:26.476580 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:26.477317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:26.477954 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:26.616736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:26.626057 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:26.628380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:26.629578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-41ac83ce-6d05-46e8-8f68-319a7d817e53 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.167336 Jun 20 11:15:26.630198 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 412/818] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:26 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:27.649279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:27.650696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:27.658267 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:27.658739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:27.659623 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:27.660198 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:27.815960 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:27.825759 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:27.827266 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:27.828443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7052b34-a2f3-43db-8257-f18abd77ecd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.183605 Jun 20 11:15:27.829010 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 407/819] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:27 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:28.850479 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:28.851148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:28.861514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:28.862154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:28.863408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:28.863909 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:28.998392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:29.007408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:29.008909 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:29.010267 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d358f0b1-06f5-4338-b591-1744ef68593d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.165312 Jun 20 11:15:29.010793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 413/820] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:28 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:30.035350 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:30.036327 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:30.043776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:30.044220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:30.044977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:30.045399 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:30.048054 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:15:30.181708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:30.191301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:30.193077 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:30.194531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-619c804b-fa02-4d4d-bae1-89a6bc78c28e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.163137 Jun 20 11:15:30.195079 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 408/821] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:30 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:15:31.217956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:31.218918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:31.225992 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:31.226499 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:31.227268 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:31.227705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:31.381576 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:31.390771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:31.392258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:31.393417 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dc22787a-f364-46e2-884c-6e1dbb19ced1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.181803 Jun 20 11:15:31.393970 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 414/822] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:31 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:32.412706 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:32.413646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:32.420256 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:32.420700 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:32.421455 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:32.421884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:32.560283 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:32.569588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:32.571479 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:32.572675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-213e30f9-3796-4f0f-b51a-a040ad82c80c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.164136 Jun 20 11:15:32.573241 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 409/823] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:32 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:33.591490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:33.592144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:33.600033 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:33.600487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:33.601287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:33.601720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:33.750508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:33.759724 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:33.761226 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:33.762420 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7d6d9431-5f54-4cf5-b31c-298dabd59467 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.175070 Jun 20 11:15:33.762980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 415/824] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:33 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:34.781810 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:34.782511 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:34.789605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:34.790080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:34.790849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:34.791282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:34.930408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:34.939887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:34.941372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:34.942592 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8083a119-af31-40bd-8da5-e7b37523fbf2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.164808 Jun 20 11:15:34.943186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 410/825] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:34 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:35.961789 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:35.963187 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:35.970123 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:35.970599 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:35.971372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:35.971840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:36.113822 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:36.122950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:36.124463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:36.125652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-80b2fc2f-fa70-4c4f-9755-eb7493d6b141 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.168267 Jun 20 11:15:36.126255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 416/826] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:35 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:37.148543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:37.149381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:37.152250 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=30 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:15:37.158511 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:37.158951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:37.159720 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:37.160200 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:37.302235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:37.312165 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:37.313641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:37.314815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7cc0c289-78a9-429b-8806-e9e03b765ae0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.172571 Jun 20 11:15:37.315346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 411/827] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:37 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:38.333244 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:38.333827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:38.341230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:38.341682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:38.342485 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:38.342918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:38.496781 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:38.506142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:38.507731 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:38.509168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e5bda927-26aa-493c-b187-d1406bec52fa tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.179711 Jun 20 11:15:38.509667 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 417/828] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:38 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:39.531764 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:39.532677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:39.541377 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:39.541826 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:39.542620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:39.543042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:39.689257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:39.698640 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:39.700126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:39.701293 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-214c5deb-ba13-4129-9dd8-3ebfbadd84a4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.176179 Jun 20 11:15:39.701874 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 412/829] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:39 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:40.720630 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:40.721211 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:40.728531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:40.728989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:40.729744 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:40.730204 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:40.870607 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:40.880141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:40.881628 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:40.882834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-820b809f-ae31-4863-99a6-f8e2db1956a3 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.166297 Jun 20 11:15:40.883357 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 418/830] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:40 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:41.905026 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:41.905619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:41.913030 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:41.913470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:41.914260 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:41.914869 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:42.058861 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:42.068529 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:42.070133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:42.071328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-238a4340-adbe-4167-ab89-8f60cf485677 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.170456 Jun 20 11:15:42.071977 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 413/831] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:41 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:43.091502 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:43.092122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:43.101311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:43.101757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:43.102566 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:43.103024 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:43.249433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:43.262328 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:43.264892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:43.266156 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c3dd5882-bcaf-4c8b-b485-e2efbc962839 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.179063 Jun 20 11:15:43.266738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 419/832] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:43 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:44.285984 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:44.286627 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:44.293894 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:44.294375 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:44.295161 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:44.295601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:44.436036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:44.445124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:44.446707 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:44.447932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0ee1c9ad-7c33-447f-b052-831a26f61a73 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.166554 Jun 20 11:15:44.448497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 414/833] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:44 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:45.470463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:45.471102 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:45.480955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:45.481406 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:45.482221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:45.482688 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:45.626389 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:45.640342 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:45.641842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:45.643065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-924808eb-4717-4c30-93a3-27655b4375c6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.178545 Jun 20 11:15:45.643626 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 420/834] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:45 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:46.661311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:46.661917 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:46.669456 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:46.669897 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:46.670704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:46.671131 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:46.814420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:46.823952 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:46.825439 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:46.826665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ca63649c-dba6-46c9-acdb-e065959fb9de tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.169449 Jun 20 11:15:46.827228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 415/835] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:46 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:47.845262 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:47.845841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:47.853075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:47.853594 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:47.854406 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:47.854837 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:47.994332 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:48.007877 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:48.010577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:48.012450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3acd0ac0-188c-42c6-8182-d3ec4082d66c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.171097 Jun 20 11:15:48.013330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 421/836] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:47 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:49.034799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:49.035670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:49.044692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:49.045146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:49.045927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:49.046395 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:49.189963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:49.197634 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:49.199568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:49.200568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-bace2c0c-e0dc-4411-b59a-9908f7d8164b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.171227 Jun 20 11:15:49.201114 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 416/837] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:49 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:49.699544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-3cb363a9-a817-4214-9a1e-a3a43d36da7c req-ecf3a20f-f4e8-4916-b477-c352ad431346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "name": "network-vif-plugged", "status": "completed", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:15:49.710621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3cb363a9-a817-4214-9a1e-a3a43d36da7c req-ecf3a20f-f4e8-4916-b477-c352ad431346 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:49.711060 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3cb363a9-a817-4214-9a1e-a3a43d36da7c req-ecf3a20f-f4e8-4916-b477-c352ad431346 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:49.725881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-3cb363a9-a817-4214-9a1e-a3a43d36da7c req-ecf3a20f-f4e8-4916-b477-c352ad431346 service nova] Creating event network-vif-plugged:4865ebb8-bb27-4185-b60c-1808baf91968 for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 on hv-cinder-84614 Jun 20 11:15:49.731251 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-3cb363a9-a817-4214-9a1e-a3a43d36da7c req-ecf3a20f-f4e8-4916-b477-c352ad431346 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186681 Jun 20 11:15:49.731849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 422/838] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:15:50.219235 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:50.219857 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:50.227208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:50.227631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:50.228441 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:50.228871 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:50.395584 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:50.408467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:50.410929 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:50.430499 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c192ae47-b960-49a9-87f0-e5693eb9f267 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.211245 Jun 20 11:15:50.431354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 417/839] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:50 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:51.453055 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:51.453736 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:51.460933 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:51.461376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:51.462179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:51.462611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:51.608110 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:51.616814 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:51.618336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:51.619518 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bb2e5111-2845-4221-b03f-3ed8fa5d5e51 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.171881 Jun 20 11:15:51.620106 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 423/840] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:51 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:52.639637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:52.640382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:52.649292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:52.649777 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:52.650598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:52.651233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:52.807551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:52.817481 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:52.819002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:52.820212 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-907eddb8-5e10-4e77-8a85-138999c89af0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1808 microversion: 2.20 time: 0.185556 Jun 20 11:15:52.820776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 418/841] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:52 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:15:53.838734 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:15:53.839473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:15:53.846783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:53.847693 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:53.848521 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:15:53.848998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:15:53.853863 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=81 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:15:54.001264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:54.010508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:54.012588 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:15:54.013502 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8d626c1f-55ac-4050-8d86-0cd054c79257 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1795 microversion: 2.20 time: 0.179146 Jun 20 11:15:54.014382 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 424/842] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:15:53 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1795 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:16:41.180187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=15 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:16:41.181106 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=65 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:16:41.186955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:41.187521 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:41.193621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=27 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:16:41.195398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=5 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:16:41.197559 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:41.198023 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:41.198939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:41.199365 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:41.227377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:16:41.319603 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fd7a53f3-deaf-4f8f-9532-b116e9f72565 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 204 len: 0 microversion: 2.1 time: 0.136798 Jun 20 11:16:41.324259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 425/843] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:16:41 2022] DELETE /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:16:41.329828 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:41.330080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-7c7092d3-ace2-4fb1-91ff-951e01300e55 req-caac2c5f-50ed-49d4-9391-4363a0b7455f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a914d5-de24-456e-8214-b1aea3be01d3", "tag": "c7f3de09-c75f-445f-98c5-4dbaae29e1be"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:16:41.330552 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:41.338852 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:41.339335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:41.340390 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:41.340831 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:41.340961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7c7092d3-ace2-4fb1-91ff-951e01300e55 req-caac2c5f-50ed-49d4-9391-4363a0b7455f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:41.341610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-7c7092d3-ace2-4fb1-91ff-951e01300e55 req-caac2c5f-50ed-49d4-9391-4363a0b7455f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:41.353348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-7c7092d3-ace2-4fb1-91ff-951e01300e55 req-caac2c5f-50ed-49d4-9391-4363a0b7455f service nova] Creating event network-changed:c7f3de09-c75f-445f-98c5-4dbaae29e1be for instance 49a914d5-de24-456e-8214-b1aea3be01d3 on hv-cinder-84614 Jun 20 11:16:41.358713 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-7c7092d3-ace2-4fb1-91ff-951e01300e55 req-caac2c5f-50ed-49d4-9391-4363a0b7455f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183428 Jun 20 11:16:41.359549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 419/844] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:16:41.480590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:41.488510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-65b29e31-3f47-40ff-9708-3750b1db7082 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1580 microversion: 2.1 time: 0.162958 Jun 20 11:16:41.489120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 426/845] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:41 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:16:42.508610 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:42.509327 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:42.516258 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:42.516704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:42.517478 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:42.517906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:42.680808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:42.689866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36b39c76-2f79-4ff9-8f58-8b0195265afc tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1580 microversion: 2.1 time: 0.186257 Jun 20 11:16:42.690489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 420/846] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:42 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1580 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:16:43.706864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:43.708143 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:43.716070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:43.716588 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:43.717411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:43.717954 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:43.752613 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-ab85fa74-0572-4b26-81db-dedefecb9d4b req-7178c3fa-be08-40c3-b01e-f269616e522b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a914d5-de24-456e-8214-b1aea3be01d3", "name": "network-vif-deleted", "tag": "c7f3de09-c75f-445f-98c5-4dbaae29e1be"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:16:43.762962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ab85fa74-0572-4b26-81db-dedefecb9d4b req-7178c3fa-be08-40c3-b01e-f269616e522b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:43.763577 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ab85fa74-0572-4b26-81db-dedefecb9d4b req-7178c3fa-be08-40c3-b01e-f269616e522b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:43.775721 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-ab85fa74-0572-4b26-81db-dedefecb9d4b req-7178c3fa-be08-40c3-b01e-f269616e522b service nova] Creating event network-vif-deleted:c7f3de09-c75f-445f-98c5-4dbaae29e1be for instance 49a914d5-de24-456e-8214-b1aea3be01d3 on hv-cinder-84614 Jun 20 11:16:43.781556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-ab85fa74-0572-4b26-81db-dedefecb9d4b req-7178c3fa-be08-40c3-b01e-f269616e522b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106887 Jun 20 11:16:43.782439 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 427/847] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:16:43.795528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:43.803320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-efb735a0-be21-4fa1-9c5a-6f2720ff2595 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 200 len: 1226 microversion: 2.1 time: 0.100384 Jun 20 11:16:43.803933 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 421/848] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:43 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:16:44.824745 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:44.825445 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 49a914d5-de24-456e-8214-b1aea3be01d3] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:44.832652 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:44.833097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:44.833857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:44.834329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:44.848066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] HTTP exception thrown: Instance 49a914d5-de24-456e-8214-b1aea3be01d3 could not be found. Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Request method failure captured: Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 HTTP/1.1 Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFSqsR68xAXP_lxMAVD04KGHmmQ1P6NqlkGYTbzf7L4S_OBNx7_uXF5BFOoJZSREHszcBna6i9ENeAeuTI4Uq2NXZDJS9zyjjOdJvbsqfTP4EF3Y34QqBG5QqAcFuov30oKS7p2E7HuWAugOjNIDpvQRmT95cFV3G-8KqIcAM8NOMqU Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:16:44.849712 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: ee21ef9eacd24177a852f28d17376191 Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 49a914d5-de24-456e-8214-b1aea3be01d3 could not be found. Jun 20 11:16:44.851470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '49a914d5-de24-456e-8214-b1aea3be01d3'} Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49a914d5-de24-456e-8214-b1aea3be01d3 could not be found. Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:16:44.852668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49a914d5-de24-456e-8214-b1aea3be01d3 could not be found. Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49a914d5-de24-456e-8214-b1aea3be01d3 could not be found. Jun 20 11:16:44.854403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:44.856018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Returning 404 to user: Instance 49a914d5-de24-456e-8214-b1aea3be01d3 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:16:44.856018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2317b320-6450-4eae-9a65-5a7a31415e05 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3" status: 404 len: 111 microversion: 2.1 time: 0.031093 Jun 20 11:16:44.856018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 428/849] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:44 2022] GET /compute/v2.1/servers/49a914d5-de24-456e-8214-b1aea3be01d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:16:48.028909 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:48.029438 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-b527b44b-971b-4164-a4cd-951bef925f78 req-32de7220-a217-411b-b35d-e2d652684039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0bd9d86-9ab6-41fe-91a0-56a60a049a10", "tag": "c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:16:48.029856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:48.038405 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:48.038831 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:48.039979 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:48.040426 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:48.043247 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-b527b44b-971b-4164-a4cd-951bef925f78 req-32de7220-a217-411b-b35d-e2d652684039 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:48.043696 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-b527b44b-971b-4164-a4cd-951bef925f78 req-32de7220-a217-411b-b35d-e2d652684039 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:48.055892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-b527b44b-971b-4164-a4cd-951bef925f78 req-32de7220-a217-411b-b35d-e2d652684039 service nova] Creating event network-changed:c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1 for instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 on hv-cinder-84614 Jun 20 11:16:48.062282 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-b527b44b-971b-4164-a4cd-951bef925f78 req-32de7220-a217-411b-b35d-e2d652684039 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038310 Jun 20 11:16:48.063069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 429/850] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:16:48.068592 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:16:48.162635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-573fc299-839c-40f2-908c-92060a8c87b4 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 204 len: 0 microversion: 2.1 time: 0.140399 Jun 20 11:16:48.163560 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 422/851] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:16:48 2022] DELETE /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:16:48.172669 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:48.173315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:48.181108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:48.181720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:48.182540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:48.183352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:48.341744 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:48.349892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-03af124c-7192-430b-bec0-192c47349f8f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1579 microversion: 2.1 time: 0.181343 Jun 20 11:16:48.350508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 430/852] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:48 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1579 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:16:49.368948 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:49.369656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:49.376624 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:49.377073 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:49.377816 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:49.378307 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:49.745866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee21ef9eacd24177a852f28d17376191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bb5c3721fc4505a51879dae4762b43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:49.755564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb2a8626-7d7a-4e79-97c5-54dd25ce270f tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 200 len: 1393 microversion: 2.1 time: 0.391187 Jun 20 11:16:49.756156 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 423/853] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:49 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 1393 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:16:50.077746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-21dd178f-416b-41a3-bedb-a31808a32af2 req-11c52880-42f0-41e1-bb10-1d5a29462451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0bd9d86-9ab6-41fe-91a0-56a60a049a10", "name": "network-vif-deleted", "tag": "c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:16:50.087811 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-21dd178f-416b-41a3-bedb-a31808a32af2 req-11c52880-42f0-41e1-bb10-1d5a29462451 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:50.088250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-21dd178f-416b-41a3-bedb-a31808a32af2 req-11c52880-42f0-41e1-bb10-1d5a29462451 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:50.100707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-21dd178f-416b-41a3-bedb-a31808a32af2 req-11c52880-42f0-41e1-bb10-1d5a29462451 service nova] Creating event network-vif-deleted:c9c8f766-9a20-4acc-b9cf-9ad7f8d8d5b1 for instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 on hv-cinder-84614 Jun 20 11:16:50.106290 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-21dd178f-416b-41a3-bedb-a31808a32af2 req-11c52880-42f0-41e1-bb10-1d5a29462451 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Jun 20 11:16:50.106960 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 431/854] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:16:50.780214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:50.780953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: f0bd9d86-9ab6-41fe-91a0-56a60a049a10] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:50.787879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:50.788333 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:50.789355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:50.789846 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:50.806060 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] HTTP exception thrown: Instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 could not be found. Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Request method failure captured: Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 HTTP/1.1 Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFSqsR68xAXP_lxMAVD04KGHmmQ1P6NqlkGYTbzf7L4S_OBNx7_uXF5BFOoJZSREHszcBna6i9ENeAeuTI4Uq2NXZDJS9zyjjOdJvbsqfTP4EF3Y34QqBG5QqAcFuov30oKS7p2E7HuWAugOjNIDpvQRmT95cFV3G-8KqIcAM8NOMqU Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:16:50.808144 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: ee21ef9eacd24177a852f28d17376191 Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 could not be found. Jun 20 11:16:50.810171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'f0bd9d86-9ab6-41fe-91a0-56a60a049a10'} Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 could not be found. Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:16:50.811222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 could not be found. Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 could not be found. Jun 20 11:16:50.812721 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:50.814331 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Returning 404 to user: Instance f0bd9d86-9ab6-41fe-91a0-56a60a049a10 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:16:50.814331 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9f3a1f22-b3af-45ba-b7a8-37a36451ca88 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10" status: 404 len: 111 microversion: 2.1 time: 0.033393 Jun 20 11:16:50.814331 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 424/855] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:50 2022] GET /compute/v2.1/servers/f0bd9d86-9ab6-41fe-91a0-56a60a049a10 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:16:51.295127 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:51.295715 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:51.302388 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:51.302829 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:51.303587 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:51.304006 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:51.318969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] HTTP exception thrown: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Request method failure captured: Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 HTTP/1.1 Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFSqsR68xAXP_lxMAVD04KGHmmQ1P6NqlkGYTbzf7L4S_OBNx7_uXF5BFOoJZSREHszcBna6i9ENeAeuTI4Uq2NXZDJS9zyjjOdJvbsqfTP4EF3Y34QqBG5QqAcFuov30oKS7p2E7HuWAugOjNIDpvQRmT95cFV3G-8KqIcAM8NOMqU Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:16:51.321461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: ee21ef9eacd24177a852f28d17376191 Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.322966 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '93072671-19ba-4bf7-bfb9-c5d98181cd98'} Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:16:51.323708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.324905 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.326375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Returning 404 to user: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:16:51.326375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dc2eeea1-2537-4453-8080-b8657774c8af tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 404 len: 111 microversion: 2.1 time: 0.033329 Jun 20 11:16:51.326375 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 432/856] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:16:51 2022] DELETE /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:16:51.331781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:51.332397 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] [instance: 93072671-19ba-4bf7-bfb9-c5d98181cd98] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:51.340694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:51.341151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:51.341935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:51.342490 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:51.356923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] HTTP exception thrown: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Request method failure captured: Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 HTTP/1.1 Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFSqsR68xAXP_lxMAVD04KGHmmQ1P6NqlkGYTbzf7L4S_OBNx7_uXF5BFOoJZSREHszcBna6i9ENeAeuTI4Uq2NXZDJS9zyjjOdJvbsqfTP4EF3Y34QqBG5QqAcFuov30oKS7p2E7HuWAugOjNIDpvQRmT95cFV3G-8KqIcAM8NOMqU Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:16:51.358496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17bb5c3721fc4505a51879dae4762b43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 17bb5c3721fc4505a51879dae4762b43 Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-TestVolumeBootPattern-66375657 Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: ee21ef9eacd24177a852f28d17376191 Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-TestVolumeBootPattern-66375657-project Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.360110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '93072671-19ba-4bf7-bfb9-c5d98181cd98'} Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:16:51.360966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. Jun 20 11:16:51.362322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:16:51.363472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Returning 404 to user: Instance 93072671-19ba-4bf7-bfb9-c5d98181cd98 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:16:51.363472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-758db50b-80ce-416b-98e1-69f407c17643 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98" status: 404 len: 111 microversion: 2.1 time: 0.032086 Jun 20 11:16:51.363472 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 425/857] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:16:51 2022] GET /compute/v2.1/servers/93072671-19ba-4bf7-bfb9-c5d98181cd98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:16:52.676303 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-50822c8b-3346-4892-bc91-b17a8f3a4d98 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] Calling method '.version_select at 0x7f72152a1310>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:52.701117 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-50822c8b-3346-4892-bc91-b17a8f3a4d98 tempest-TestVolumeBootPattern-66375657 tempest-TestVolumeBootPattern-66375657-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1558821828" status: 202 len: 0 microversion: 2.1 time: 0.028773 Jun 20 11:16:52.701749 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 433/858] 10.222.0.33 () {58 vars in 1262 bytes} [Mon Jun 20 11:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1558821828 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:16:57.786861 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:57.788067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:57.795629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:57.796083 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:57.797070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:57.797513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:57.829694 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-981c8f06-7185-4d56-a79d-2f21432d26c2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments/8bb8f5b1-8feb-41de-9871-6758112cfd66" status: 200 len: 194 microversion: 2.20 time: 0.048501 Jun 20 11:16:57.838068 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 426/859] 10.222.0.33 () {60 vars in 1453 bytes} [Mon Jun 20 11:16:57 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments/8bb8f5b1-8feb-41de-9871-6758112cfd66 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:16:57.912705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:57.914779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:57.922790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:57.923250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:57.924515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:57.925284 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:58.038262 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lazy-loading 'services' on Instance uuid 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:16:58.137857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b245aa93-6b3b-4ad4-9efc-5e46093a9131 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments/8bb8f5b1-8feb-41de-9871-6758112cfd66" status: 202 len: 0 microversion: 2.20 time: 0.230131 Jun 20 11:16:58.139293 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 434/860] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jun 20 11:16:57 2022] DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments/8bb8f5b1-8feb-41de-9871-6758112cfd66 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:16:58.148278 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:58.150380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:58.159318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:58.160108 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:58.160953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:58.161565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:58.204749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-03105a97-de48-4e1e-aafa-1f1bf62887b0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061051 Jun 20 11:16:58.206070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 427/861] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jun 20 11:16:58 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:16:59.218897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:59.220900 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:59.231207 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:59.232029 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:59.232956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:59.233492 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:59.277899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a50351b3-a47e-49dd-b067-177cd2bca44f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064038 Jun 20 11:16:59.279041 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 435/862] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jun 20 11:16:59 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:16:59.366485 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:59.367214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:59.376052 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:59.376506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:59.377684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:59.378598 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:59.437854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:16:59.532380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-19570380-99a7-4738-bb2f-3d19428eabf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 204 len: 0 microversion: 2.20 time: 0.169732 Jun 20 11:16:59.533086 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 428/863] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 20 11:16:59 2022] DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:16:59.542049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:16:59.542674 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:16:59.548985 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:59.549441 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:59.550260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:16:59.551249 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:16:59.711948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:59.721470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:59.725842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:16:59.729875 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-de80d376-b908-4801-a041-a459376a5c84 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.191014 Jun 20 11:16:59.731254 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 436/864] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:16:59 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:00.760104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:00.761028 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:00.768065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:00.768602 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:00.769470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:00.769974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:00.919699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:00.928754 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:00.931081 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:00.932791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-89949788-fb4a-40f9-b14a-f7daae3558fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.181024 Jun 20 11:17:00.942110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 429/865] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:00 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:01.952451 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:01.953059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:01.960319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:01.960772 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:01.961525 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:01.962000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:02.098881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:02.107775 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:02.109418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:02.110713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7e085159-eb0b-45d1-b289-a6bd614c8428 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 200 len: 1723 microversion: 2.20 time: 0.162473 Jun 20 11:17:02.111325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 437/866] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:01 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:02.436780 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-70c49cbb-1cbf-46b9-b5b7-44ac12677bfe req-28bc8c9b-ead3-4641-ae7b-4339c76f95d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83d13cd6-1aed-40e5-94b0-7b0ce9e863b4", "name": "network-vif-deleted", "tag": "4865ebb8-bb27-4185-b60c-1808baf91968"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:17:02.452990 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-70c49cbb-1cbf-46b9-b5b7-44ac12677bfe req-28bc8c9b-ead3-4641-ae7b-4339c76f95d2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:02.453708 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-70c49cbb-1cbf-46b9-b5b7-44ac12677bfe req-28bc8c9b-ead3-4641-ae7b-4339c76f95d2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:02.467482 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-70c49cbb-1cbf-46b9-b5b7-44ac12677bfe req-28bc8c9b-ead3-4641-ae7b-4339c76f95d2 service nova] Creating event network-vif-deleted:4865ebb8-bb27-4185-b60c-1808baf91968 for instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 on hv-cinder-84614 Jun 20 11:17:02.473343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-70c49cbb-1cbf-46b9-b5b7-44ac12677bfe req-28bc8c9b-ead3-4641-ae7b-4339c76f95d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040853 Jun 20 11:17:02.473954 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 430/867] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:17:03.129242 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:03.129801 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:03.138337 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:03.138882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:03.139733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:03.140450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:03.156970 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] HTTP exception thrown: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Request method failure captured: Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 HTTP/1.1 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFYt9lessjzdW5974lRQ6RFLgIkMHXq37DhocnO0UWZmxgH1_xoTj5X7T_iskRTUyV5mVHWzYFGKb1wioVLsfZtZo04RLq6hglRBwlsFsosSk0ahccKKanegkrHIJjOy-3ovf5UByQMgtkw2yVENjjD_3ubXcdCoLlj51ynsPiuYMcY Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:17:03.158161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: b7275026b00b4e93bed7682b3ff2525c Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:17:03.160061 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '83d13cd6-1aed-40e5-94b0-7b0ce9e863b4'} Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:17:03.161027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:17:03.163544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:17:03.165032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Returning 404 to user: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:17:03.165032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b561691b-588e-4c84-8ffb-f4de2260770e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 404 len: 111 microversion: 2.20 time: 0.034435 Jun 20 11:17:03.165032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 438/868] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:03 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:17:03.170509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-068c68b4-c376-4423-87ea-86a3fcbcea85 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '.version_select at 0x7f72159a7550>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:03.173824 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-068c68b4-c376-4423-87ea-86a3fcbcea85 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [a3b56035-41c6-467a-9b25-bccffe2ade36] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 11:17:04.182347 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-068c68b4-c376-4423-87ea-86a3fcbcea85 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [a3b56035-41c6-467a-9b25-bccffe2ade36] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 36454. Jun 20 11:17:04.202739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-068c68b4-c376-4423-87ea-86a3fcbcea85 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528954725" status: 204 len: 0 microversion: 2.20 time: 1.037384 Jun 20 11:17:04.203340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 431/869] 10.222.0.33 () {60 vars in 1258 bytes} [Mon Jun 20 11:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528954725 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:17:04.886804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-efa09c6e-89c9-4dfb-be85-388608cc0df4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'create', calling method: .version_select at 0x7f7215371d30>, body: {"keypair": {"name": "tempest-keypair-978548769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4Q7h7iKxBQjMqGmN+TCELHghxPS1fDXHuLTu2b3W3z4rYNa/Tetg6VX7VHLz/tUOeMdL0zGzNx8BScIkOXREECrHco/rfhViue5d3y5/r8joa32m1f7aWS9mubnkpAUQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:17:04.905174 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-efa09c6e-89c9-4dfb-be85-388608cc0df4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for project 5778b58ba0bb4bebb334d08971c67323. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:17:04.909687 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-efa09c6e-89c9-4dfb-be85-388608cc0df4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for user b7275026b00b4e93bed7682b3ff2525c and project 5778b58ba0bb4bebb334d08971c67323. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:17:04.939894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-efa09c6e-89c9-4dfb-be85-388608cc0df4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.058028 Jun 20 11:17:04.941728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 439/870] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jun 20 11:17:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 11:17:06.286124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1180134277", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "504cbbcf-5657-42f1-92b8-430ba48b2c83"}], "security_groups": [{"name": "tempest-securitygroup--509837599"}], "key_name": "tempest-keypair-978548769", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:17:06.395452 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] validate_networks() for [('504cbbcf-5657-42f1-92b8-430ba48b2c83', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:17:06.923506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:17:06.923928 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:17:06.924394 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:17:06.924794 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:17:06.925211 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:17:06.935318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:06.935760 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:06.936564 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:06.937000 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:06.954752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for project 5778b58ba0bb4bebb334d08971c67323. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:17:06.959386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Getting quotas for user b7275026b00b4e93bed7682b3ff2525c and project 5778b58ba0bb4bebb334d08971c67323. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:17:06.972226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:17:06.974645 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:17:07.025444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-88cf962c-10d3-455d-81b5-a91c10e96a5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.744049 Jun 20 11:17:07.026119 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 432/871] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jun 20 11:17:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 11:17:07.037023 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-08d3a8ab-a090-43c3-a9bc-412aa224803d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:07.037590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-08d3a8ab-a090-43c3-a9bc-412aa224803d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:07.096511 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08d3a8ab-a090-43c3-a9bc-412aa224803d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:07.104529 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08d3a8ab-a090-43c3-a9bc-412aa224803d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:07.106022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08d3a8ab-a090-43c3-a9bc-412aa224803d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:07.107157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-08d3a8ab-a090-43c3-a9bc-412aa224803d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1281 microversion: 2.20 time: 0.074805 Jun 20 11:17:07.107713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 440/872] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:07 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:08.125522 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:08.126146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:08.133875 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:08.134926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:08.136016 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:08.136446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:08.247811 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:08.260386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:08.264214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:08.265083 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a6d59173-ef44-4c29-9377-04f8cf5070a2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1341 microversion: 2.20 time: 0.143555 Jun 20 11:17:08.266667 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 433/873] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:08 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1341 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:09.293237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:09.293939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:09.302454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:09.302912 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:09.303891 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:09.304398 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:09.450144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:09.460122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:09.461886 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:09.463086 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-03ff5e10-40f5-4531-9a27-50bd3162bdcb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.174238 Jun 20 11:17:09.464146 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 441/874] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:09 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:09.591874 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-8f274e20-2ab8-467f-91e1-84132c1cab9b req-795ac35e-a829-490f-8ac6-04f6c798c5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:17:09.603869 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8f274e20-2ab8-467f-91e1-84132c1cab9b req-795ac35e-a829-490f-8ac6-04f6c798c5a7 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:09.604281 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8f274e20-2ab8-467f-91e1-84132c1cab9b req-795ac35e-a829-490f-8ac6-04f6c798c5a7 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:09.621448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-8f274e20-2ab8-467f-91e1-84132c1cab9b req-795ac35e-a829-490f-8ac6-04f6c798c5a7 service nova] Creating event network-changed:7693928f-b602-4a81-9cf7-a09ac71ea250 for instance 9ed05903-9a40-4072-a475-0d9de039da3e on hv-cinder-84614 Jun 20 11:17:09.626796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-8f274e20-2ab8-467f-91e1-84132c1cab9b req-795ac35e-a829-490f-8ac6-04f6c798c5a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038514 Jun 20 11:17:09.627632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 434/875] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:17:10.481298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:10.481889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:10.489258 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:10.489707 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:10.490528 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:10.490967 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:10.626841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:10.635260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:10.636776 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:10.637944 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ee45b6fe-87f6-4858-baec-c6857b2bac9a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.160920 Jun 20 11:17:10.638571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 442/876] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:10 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:11.660901 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:11.661609 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:11.664194 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:11.670988 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:11.671654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:11.672921 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:11.673641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:11.678114 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:11.821673 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:11.829746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:11.831279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:11.832470 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-aec32eb1-62f0-4aea-b8e5-97e300bd30bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.178953 Jun 20 11:17:11.833040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 435/877] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:11 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:12.852336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:12.853165 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:12.855773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:12.861596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:12.862045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:12.862819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:12.863285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:12.866684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:13.014037 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:13.024836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:13.027122 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:13.028871 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-17092183-5ed7-4615-9ef8-a5ffd6702835 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.180398 Jun 20 11:17:13.029774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 443/878] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:12 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:14.047680 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:14.048317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:14.055406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:14.055898 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:14.056890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:14.058219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:14.203788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:14.212601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:14.214167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:14.215364 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cdb8c3ed-36b6-44ce-927f-81a909bddddd tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.171871 Jun 20 11:17:14.215913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 436/879] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:14 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:17:15.233477 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:15.234030 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:15.244217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:15.244804 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:15.245890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:15.246579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:15.380975 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:15.389709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:15.391253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:15.392377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c44b761c-00f6-49b2-837b-71e52a2d7130 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.163125 Jun 20 11:17:15.392942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 444/880] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:15 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:15.905601 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-057c6f80-db8f-48ff-837b-07cdf7154f7b req-8866abc6-744b-4f3b-808d-5860905b5fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "name": "network-vif-plugged", "status": "completed", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:17:15.914747 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-057c6f80-db8f-48ff-837b-07cdf7154f7b req-8866abc6-744b-4f3b-808d-5860905b5fc2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:15.915202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-057c6f80-db8f-48ff-837b-07cdf7154f7b req-8866abc6-744b-4f3b-808d-5860905b5fc2 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:15.928027 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-057c6f80-db8f-48ff-837b-07cdf7154f7b req-8866abc6-744b-4f3b-808d-5860905b5fc2 service nova] Creating event network-vif-plugged:7693928f-b602-4a81-9cf7-a09ac71ea250 for instance 9ed05903-9a40-4072-a475-0d9de039da3e on hv-cinder-84614 Jun 20 11:17:15.933336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-057c6f80-db8f-48ff-837b-07cdf7154f7b req-8866abc6-744b-4f3b-808d-5860905b5fc2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Jun 20 11:17:15.934751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 437/881] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:17:16.410825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:16.411414 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:16.418036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:16.418597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:16.419383 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:16.419821 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:16.561787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:16.570372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:16.571881 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:16.573007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4c366868-a5e4-492b-87ac-d3c255327775 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.166397 Jun 20 11:17:16.573573 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 445/882] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:16 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:17.591716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:17.592920 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:17.600158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:17.601301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:17.610772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:17.611208 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:17.611962 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:17.612392 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:17.759807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:17.770422 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:17.771905 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:17.773105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-35a8f0ea-45b6-46fe-acf0-c4753bf82b5c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1406 microversion: 2.20 time: 0.184424 Jun 20 11:17:17.773664 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 438/883] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:17 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:18.792479 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:18.793085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:18.795049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:17:18.801623 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:18.802234 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:18.803437 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:18.803890 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:18.960159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:18.969000 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:18.970560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:17:18.971694 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4dd97ead-0030-4248-ad79-30dc2efc3524 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1598 microversion: 2.20 time: 0.183227 Jun 20 11:17:18.972251 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 446/884] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:17:18 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:17:18.990297 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:17:18.990959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:17:18.998075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:18.998566 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:18.999580 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:19.000016 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:19.085112 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9de7184d-0093-42c4-82a6-c0dc4c0dbfbf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098789 Jun 20 11:17:19.085717 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 439/885] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jun 20 11:17:18 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 11:17:20.330684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-3ef3b11c-ab21-437a-b428-b5ffbb3f1627 req-be49c58b-1922-49e6-8ce3-26d7a114f23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:17:20.339480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3ef3b11c-ab21-437a-b428-b5ffbb3f1627 req-be49c58b-1922-49e6-8ce3-26d7a114f23e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:17:20.339922 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3ef3b11c-ab21-437a-b428-b5ffbb3f1627 req-be49c58b-1922-49e6-8ce3-26d7a114f23e service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:17:20.354779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-3ef3b11c-ab21-437a-b428-b5ffbb3f1627 req-be49c58b-1922-49e6-8ce3-26d7a114f23e service nova] Creating event network-changed:7693928f-b602-4a81-9cf7-a09ac71ea250 for instance 9ed05903-9a40-4072-a475-0d9de039da3e on hv-cinder-84614 Jun 20 11:17:20.360197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-3ef3b11c-ab21-437a-b428-b5ffbb3f1627 req-be49c58b-1922-49e6-8ce3-26d7a114f23e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033297 Jun 20 11:17:20.360932 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 447/886] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:18:02.621251 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:18:02.622163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:18:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:18:25.080169 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=9 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:25.080887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=23 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:25.260302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:25.260800 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:25.267165 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:25.267612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:25.268377 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:25.268837 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:25.292863 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-18b0f2bc-c616-42d1-8259-aa5cfa965359 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/ips" status: 200 len: 152 microversion: 2.20 time: 0.214750 Jun 20 11:18:25.293699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 440/887] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jun 20 11:18:25 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/ips => generated 152 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:18:27.178977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=9 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:27.179725 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=25 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:27.184738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:18:27.185530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:27.192836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:27.193276 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:27.194043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:27.194500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:27.218256 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lazy-loading 'flavor' on Instance uuid 9ed05903-9a40-4072-a475-0d9de039da3e {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:18:27.510698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d45d66b6-4565-495e-903b-3c96c7612d6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/action" status: 202 len: 0 microversion: 2.20 time: 0.333607 Jun 20 11:18:27.511348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 448/888] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 20 11:18:27 2022] POST /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:18:27.519710 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:27.520963 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:27.527828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:27.528280 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:27.529049 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:27.529483 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:27.663647 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:27.671720 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:27.673197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:27.674423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36adf22f-fec1-4f65-8d7f-79fe684c391b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.158676 Jun 20 11:18:27.675085 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 441/889] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:27 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:28.702108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:28.702857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:28.710328 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:28.710773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:28.711547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:28.711953 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:28.861056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:28.869518 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:28.871059 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:28.872222 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-672ba398-af39-497d-88dd-175d19b41aeb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.175091 Jun 20 11:18:28.872773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 449/890] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:28 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:29.893620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:29.894279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:29.901428 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:29.901879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:29.902682 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:29.903097 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:30.050719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:30.061138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:30.063177 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:30.064830 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9ee95a25-db1e-40d9-9be6-f4332865252a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.174993 Jun 20 11:18:30.065749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 442/891] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:29 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:31.084311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:31.085152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:31.091937 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:31.092414 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:31.093171 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:31.093598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:31.231380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:31.239655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:31.241239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:31.242648 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4203425d-9b50-4ca0-879f-5d9abe0b9e6c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.162219 Jun 20 11:18:31.243297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 450/892] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:31 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:32.263339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:32.264002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:32.270430 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:32.270873 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:32.271630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:32.272075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:32.412239 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:32.422617 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:32.424328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:32.425787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3c5f91b4-acb1-4444-820f-ccd7dd2b7197 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.166265 Jun 20 11:18:32.426892 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 443/893] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:32 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:18:33.447376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:33.448044 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:33.455103 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:33.455548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:33.456317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:33.456748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:33.607841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:33.618319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:33.619851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:33.621480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4d653621-63d5-41ed-b06b-6fcaa30bfec2 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.178710 Jun 20 11:18:33.622431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 451/894] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:33 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:34.641121 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:34.641746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:34.649021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:34.649469 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:34.650304 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:34.650737 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:34.795118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:34.804516 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:34.806007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:34.807571 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1ab2ce8e-eb81-4ea9-b896-5d84e71956a9 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.170429 Jun 20 11:18:34.808134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 444/895] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:34 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:35.828224 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:35.828973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:35.836593 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:35.837020 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:35.838032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:35.838660 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:35.980255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:35.990538 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:35.992597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:35.993851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5cdcd251-1105-4e4c-9218-1cdb34c618fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.172394 Jun 20 11:18:35.994502 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 452/896] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:35 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:37.014790 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:37.015431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:37.022476 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:37.023606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:37.024374 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:37.024804 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:37.168497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:37.178923 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:37.180512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:37.182039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b235bfcf-b2ea-48e8-8490-7a8d4bebea1e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.171259 Jun 20 11:18:37.182641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 445/897] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:37 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:38.200765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:38.201349 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:38.209765 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:38.210453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:38.211230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:38.211802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:38.361543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:38.370376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:38.371916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:38.373106 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-80c0f3e8-1e66-473e-86f3-fbbf532c522a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.176754 Jun 20 11:18:38.373671 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 453/898] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:38 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:39.392521 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:39.393300 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:39.402387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:39.402859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:39.403701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:39.404128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:39.633148 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:39.641860 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:39.643382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:39.644622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b932e702-3bfb-43e6-b1ae-b41b3904d1db tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1744 microversion: 2.20 time: 0.256234 Jun 20 11:18:39.645172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 446/899] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:39 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1744 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:40.663315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:40.664188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:40.671296 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:40.671883 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:40.672657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:40.673112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:40.820742 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:40.832520 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:40.834925 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:40.836636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eb524d35-26e3-4a53-81ef-ce25db449639 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1744 microversion: 2.20 time: 0.177197 Jun 20 11:18:40.837204 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 454/900] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:40 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:41.858354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:41.858971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:41.866130 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:41.866613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:41.867408 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:41.867944 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:42.004821 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:42.014132 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:42.015864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:42.017032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-477232b7-7d07-47ae-a6f5-1612390b2125 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1744 microversion: 2.20 time: 0.162782 Jun 20 11:18:42.017631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 447/901] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:41 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:42.443919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-e4fba2a6-81cf-4f2c-83cd-4dce13c27c8f req-29f83b96-6a50-4457-b635-dbc83b9ae347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "name": "network-vif-plugged", "status": "completed", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:18:42.453194 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e4fba2a6-81cf-4f2c-83cd-4dce13c27c8f req-29f83b96-6a50-4457-b635-dbc83b9ae347 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:42.453714 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e4fba2a6-81cf-4f2c-83cd-4dce13c27c8f req-29f83b96-6a50-4457-b635-dbc83b9ae347 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:42.465885 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-e4fba2a6-81cf-4f2c-83cd-4dce13c27c8f req-29f83b96-6a50-4457-b635-dbc83b9ae347 service nova] Creating event network-vif-plugged:7693928f-b602-4a81-9cf7-a09ac71ea250 for instance 9ed05903-9a40-4072-a475-0d9de039da3e on hv-cinder-84614 Jun 20 11:18:42.471116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-e4fba2a6-81cf-4f2c-83cd-4dce13c27c8f req-29f83b96-6a50-4457-b635-dbc83b9ae347 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 Jun 20 11:18:42.472091 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 455/902] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:18:43.035777 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:43.036885 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:43.044739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:43.045183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:43.045959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:43.046417 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:43.187207 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:43.196621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:43.197969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:43.199195 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-26971659-d658-4ec9-95e6-6df5bc343a2e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.167335 Jun 20 11:18:43.199743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 448/903] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:43 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:44.218176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:44.218896 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:44.226157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:44.226698 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:44.227662 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:44.228431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:44.383720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:44.393503 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:44.395083 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:44.396582 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-100f6fc0-baad-4530-9e2b-191bca4304bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.183223 Jun 20 11:18:44.397729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 456/904] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:44 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:45.419181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:45.420574 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:45.428458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:45.429021 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:45.430067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:45.430723 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:45.602573 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:45.613654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:45.615354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:45.616717 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28ead1d6-d0a5-4d80-9f82-8855389e7653 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.201849 Jun 20 11:18:45.624084 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 449/905] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:45 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 11:18:46.640916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:46.641534 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:46.648493 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:46.649315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:46.650297 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:46.650814 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:46.810774 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:46.823442 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:46.824968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:46.826303 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8e69654f-f00b-414a-ad20-e1937a059d81 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.189208 Jun 20 11:18:46.827071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 457/906] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:46 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:47.845673 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:47.846368 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:47.854877 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:47.856070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:47.856070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:47.856500 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:48.028887 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:48.038204 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:48.040282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:48.041496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5b321a58-7901-464c-ae0e-86e5cdde149d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.199954 Jun 20 11:18:48.055142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 450/907] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:47 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:49.063763 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:49.064352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:49.076659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:49.077849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:49.079412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:49.080223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:49.246603 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:49.255855 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:49.257469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:49.259598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1b78a576-5374-4a34-9d90-a09af286e06a tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.200237 Jun 20 11:18:49.260249 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 458/908] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:49 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:50.283396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:50.289277 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:50.303438 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:50.304240 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:50.305970 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:50.306856 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:50.512951 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:50.525160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:50.525160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:50.525689 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a570c1d-89d9-44d0-80a6-d0e6b723aa38 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.250686 Jun 20 11:18:50.526292 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 451/909] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:50 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:51.543275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:51.544677 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:51.552360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:51.553198 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:51.554220 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:51.554858 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:51.707708 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:51.717126 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:51.718648 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:51.719812 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c12848cc-fae2-4b19-bcf8-bfcc7f8e76d1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.180583 Jun 20 11:18:51.731627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 459/910] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:51 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:52.739772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:52.740699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:52.748931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:52.749379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:52.750176 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:52.750605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:52.899559 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:52.908328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:52.909814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:52.911018 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-46feb21d-fc4f-4553-b7da-50e52fd02a59 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1739 microversion: 2.20 time: 0.175957 Jun 20 11:18:52.911581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 452/911] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:52 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:53.933078 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:53.933709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:53.941268 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:53.941713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:53.942927 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:53.943635 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:54.081826 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:54.090463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:54.092006 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:54.093179 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-47afa7de-0041-4198-bc5b-7c39ae05c5ab tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1721 microversion: 2.20 time: 0.164737 Jun 20 11:18:54.093750 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 460/912] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:53 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:55.112518 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:55.113429 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:55.115952 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=27 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:55.121862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:55.122435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:55.123215 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:55.123650 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:55.126632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=77 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:55.266220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:55.274568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:55.276069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:55.277384 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-946bb4c7-3e2e-49e8-b0af-84e21ba959c1 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1724 microversion: 2.20 time: 0.168757 Jun 20 11:18:55.278168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 453/913] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:55 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:55.295305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e317bdfe-456a-4169-a310-afe766963f37"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:18:55.296377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:55.303562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:55.304132 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:55.304899 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:55.305332 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:55.517820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:55.609259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1ab9d521-b95a-428a-af9f-3efecfe3cc47 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318059 Jun 20 11:18:55.609876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 461/914] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jun 20 11:18:55 2022] POST /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 11:18:55.735468 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:55.735890 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:55.742128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:55.742597 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:55.743355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:55.743781 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:56.012995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-878feea2-aad6-46d9-99ed-ad10f30e893e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-volume_attachments/e317bdfe-456a-4169-a310-afe766963f37" status: 202 len: 0 microversion: 2.20 time: 0.281944 Jun 20 11:18:56.013494 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 454/915] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jun 20 11:18:55 2022] DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-volume_attachments/e317bdfe-456a-4169-a310-afe766963f37 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:18:56.070656 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:18:56.071315 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:56.077627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:56.078070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:56.078844 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:56.079273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:56.160906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0da73eef-3175-4cac-b534-23e08565ffd0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "POST /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/action" status: 202 len: 0 microversion: 2.20 time: 0.093815 Jun 20 11:18:56.161486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 462/916] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 20 11:18:56 2022] POST /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:18:56.170882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:56.172232 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:56.180446 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:56.181359 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:56.182389 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:56.183031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:56.325246 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:56.339334 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:56.342656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:56.344765 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1c5e540d-39d0-4799-ba08-a355999bd5ea tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1672 microversion: 2.20 time: 0.178528 Jun 20 11:18:56.345995 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 455/917] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:56 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:56.453099 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-38764efc-7d28-4b80-aea2-512c983dd3f0 req-74351fb7-efe3-496a-a81c-c11ec30fa369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "name": "network-vif-unplugged", "status": "completed", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:18:56.466241 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-38764efc-7d28-4b80-aea2-512c983dd3f0 req-74351fb7-efe3-496a-a81c-c11ec30fa369 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:56.466684 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-38764efc-7d28-4b80-aea2-512c983dd3f0 req-74351fb7-efe3-496a-a81c-c11ec30fa369 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:56.478906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.compute.server_external_events [req-38764efc-7d28-4b80-aea2-512c983dd3f0 req-74351fb7-efe3-496a-a81c-c11ec30fa369 service nova] Unable to find a host for instance 9ed05903-9a40-4072-a475-0d9de039da3e. Dropping event network-vif-unplugged {{(pid=117605) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 11:18:56.480099 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-38764efc-7d28-4b80-aea2-512c983dd3f0 req-74351fb7-efe3-496a-a81c-c11ec30fa369 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031702 Jun 20 11:18:56.480912 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 463/918] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 20 11:18:57.371896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:57.372502 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:57.379086 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:57.379523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:57.380305 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:57.380760 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:57.594176 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:57.602751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:57.604240 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:57.605574 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-14724dcd-41a1-4a11-b58b-d3914df30c0c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.238042 Jun 20 11:18:57.606163 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 456/919] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:57 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:58.624898 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:58.625821 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:58.628152 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=35 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:18:58.634193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:58.634644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:58.635418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:58.635847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:58.799882 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:58.809268 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:58.811147 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:18:58.812917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b8bfbdde-4454-4fb9-b821-0f72a5b0bfb4 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.192253 Jun 20 11:18:58.813996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 464/920] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:58 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:18:59.832391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:18:59.833207 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:18:59.843916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:59.844481 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:59.845373 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:18:59.845884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:18:59.999866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:00.010666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:00.010666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:00.011036 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-28832795-03f5-4595-b0f0-a03b1395b6a0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.183511 Jun 20 11:19:00.011673 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 457/921] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:18:59 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:01.033077 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:01.034956 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:01.044392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:01.044851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:01.045629 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:01.046109 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:01.216317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:01.228397 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:01.232018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:01.233442 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aeb29992-822e-4508-bb31-0703e9a18c2b tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.206967 Jun 20 11:19:01.234141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 465/922] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:01 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:02.253254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:02.253935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:02.263040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:02.263519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:02.264290 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:02.264720 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:02.423142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:02.431948 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:02.433724 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:02.435183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-441ef161-3bb9-4219-a3b9-7972486ab515 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.186785 Jun 20 11:19:02.436603 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 458/923] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:02 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:03.460123 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:03.461284 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:03.468823 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:03.469393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:03.470620 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:03.471288 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:03.626190 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:03.635218 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:03.637047 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:03.638366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-635b2602-38ce-4c9a-93d6-76c654a213bf tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.186301 Jun 20 11:19:03.638955 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 466/924] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:03 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:04.658444 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:04.659775 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:04.668787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:04.669045 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:04.669744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:04.670194 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:04.822166 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:04.831228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:04.833252 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:04.834527 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e0b7affb-7244-4f7e-8067-11aa4ad036fe tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.181184 Jun 20 11:19:04.835186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 459/925] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:04 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:05.853188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:05.853823 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:05.860993 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:05.861445 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:05.862273 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:05.862719 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:06.004341 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:06.013049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:06.014597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:06.015802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bbc896fa-7c41-4465-b555-7b3257c05ccb tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.166794 Jun 20 11:19:06.016569 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 467/926] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:05 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:07.035092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:07.036072 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:07.045631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:07.046259 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:07.047133 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:07.047641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:07.203199 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:07.211622 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:07.213110 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:07.214313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-772adfbd-1034-45be-b781-7be381bbe99e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.184066 Jun 20 11:19:07.214864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 460/927] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:07 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:08.234641 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:08.235264 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:08.242257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:08.242709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:08.243484 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:08.243918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:08.388817 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:08.397584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:08.399106 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:08.400276 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-04825898-4069-4513-ac19-a445b083d062 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.171126 Jun 20 11:19:08.400848 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 468/928] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:08 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:09.419404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:09.420075 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:09.427865 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:09.428284 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:09.429050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:09.429480 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:09.578743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:09.587531 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:09.589024 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:09.590229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-807d1f46-f5a7-49db-a158-9842dc223ca7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.174816 Jun 20 11:19:09.590804 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 461/929] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:09 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:10.610156 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:10.610783 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:10.617679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:10.618150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:10.618936 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:10.619372 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:10.764427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:10.772880 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:10.774420 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:10.775600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9568617d-96c5-45a0-8413-ca5b5733d659 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.170200 Jun 20 11:19:10.776163 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 469/930] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:10 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:11.796282 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:11.797002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:11.804167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:11.804611 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:11.805381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:11.806188 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:11.949931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:11.963607 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:11.965105 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:11.966322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6a9c4c00-f807-49cd-bd27-c4f2088edb6f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.174412 Jun 20 11:19:11.967154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 462/931] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:11 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:12.575752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-491d312f-4754-4b12-9a6c-86ada844bfa7 req-ae3e6fd3-e536-4219-8043-1d4f963637df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "name": "network-vif-plugged", "status": "completed", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:19:12.585244 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-491d312f-4754-4b12-9a6c-86ada844bfa7 req-ae3e6fd3-e536-4219-8043-1d4f963637df service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:12.585816 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-491d312f-4754-4b12-9a6c-86ada844bfa7 req-ae3e6fd3-e536-4219-8043-1d4f963637df service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:12.598469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-491d312f-4754-4b12-9a6c-86ada844bfa7 req-ae3e6fd3-e536-4219-8043-1d4f963637df service nova] Creating event network-vif-plugged:7693928f-b602-4a81-9cf7-a09ac71ea250 for instance 9ed05903-9a40-4072-a475-0d9de039da3e on hv-cinder-84614 Jun 20 11:19:12.603947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-491d312f-4754-4b12-9a6c-86ada844bfa7 req-ae3e6fd3-e536-4219-8043-1d4f963637df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031936 Jun 20 11:19:12.604598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 470/932] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:19:12.987433 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:12.988070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:12.995169 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:12.995577 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:12.996353 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:12.996793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:13.148057 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:13.159093 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:13.160616 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:13.161797 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fe05f645-6852-483d-8305-2f6d484aab17 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.178505 Jun 20 11:19:13.162379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 463/933] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:12 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:14.181830 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:14.182514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:14.189976 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:14.190456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:14.191223 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:14.191738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:14.348064 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:14.356657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:14.358371 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:14.359555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2de7eef9-afc1-43df-bb47-1b21e2cf520f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1730 microversion: 2.20 time: 0.182917 Jun 20 11:19:14.360132 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 471/934] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:14 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:15.379787 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:19:15.380505 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:19:15.387406 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:15.387849 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:15.388624 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:19:15.389151 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:19:15.535699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:15.544256 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:15.545758 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:19:15.546969 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-48139033-f71e-44d3-96f3-31f07435c4d6 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1717 microversion: 2.20 time: 0.172781 Jun 20 11:19:15.547527 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 464/935] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:19:15 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:19:30.990754 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:19:30.991368 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:19:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:19:32.313030 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:19:32.313677 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:20:00.767427 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:20:00.768187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:20:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:20:03.560088 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:03.561019 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:03.563114 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=15 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:03.564401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:03.571706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:03.572150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:03.572908 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:03.573336 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:03.617876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d2890cb7-5bd7-4974-98e3-8a4f9bb83bf0 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062296 Jun 20 11:20:03.618483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 472/936] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jun 20 11:20:03 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:03.687505 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:03.688191 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:03.690749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=23 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:03.691427 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:03.698272 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:03.698722 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:03.699498 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:03.699930 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:03.729005 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:20:03.815010 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e8605f8e-b620-49e7-8602-2e03f20f8917 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 204 len: 0 microversion: 2.20 time: 0.131196 Jun 20 11:20:03.815782 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 465/937] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 20 11:20:03 2022] DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:20:03.826662 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:03.827312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:03.834045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:03.834538 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:03.835330 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:03.835772 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:04.032734 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:04.041440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:04.042972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:04.044176 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-07227350-e257-4bbe-a829-7992e377a22e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.223372 Jun 20 11:20:04.044735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 473/938] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:20:03 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:20:05.068125 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:05.069248 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:05.079882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:05.080581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:05.081937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:05.083074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:05.322911 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:05.331854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:05.333937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:05.335142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8ef6c160-ebcd-4c32-ab64-6ee199b3c44e tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1723 microversion: 2.20 time: 0.274677 Jun 20 11:20:05.335937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 466/939] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:20:05 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:20:06.353301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:06.354011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:06.361849 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:06.362348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:06.363256 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:06.363757 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:06.429779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:06.439422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:06.441189 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7275026b00b4e93bed7682b3ff2525c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5778b58ba0bb4bebb334d08971c67323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:06.442748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-294a3357-38fc-4101-b4ff-b89be0838d4d tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 200 len: 1656 microversion: 2.20 time: 0.093613 Jun 20 11:20:06.443972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 474/940] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:20:06 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 1656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 11:20:06.445513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-2e2729f8-9652-4d14-97ee-bc9cde8d1bb9 req-b461889b-42b6-435b-9a3d-c19d522daf47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed05903-9a40-4072-a475-0d9de039da3e", "name": "network-vif-deleted", "tag": "7693928f-b602-4a81-9cf7-a09ac71ea250"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:20:06.461629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-2e2729f8-9652-4d14-97ee-bc9cde8d1bb9 req-b461889b-42b6-435b-9a3d-c19d522daf47 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:06.462066 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-2e2729f8-9652-4d14-97ee-bc9cde8d1bb9 req-b461889b-42b6-435b-9a3d-c19d522daf47 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:06.483513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-2e2729f8-9652-4d14-97ee-bc9cde8d1bb9 req-b461889b-42b6-435b-9a3d-c19d522daf47 service nova] Creating event network-vif-deleted:7693928f-b602-4a81-9cf7-a09ac71ea250 for instance 9ed05903-9a40-4072-a475-0d9de039da3e on hv-cinder-84614 Jun 20 11:20:06.496548 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-2e2729f8-9652-4d14-97ee-bc9cde8d1bb9 req-b461889b-42b6-435b-9a3d-c19d522daf47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055137 Jun 20 11:20:06.497883 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 467/941] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:20:07.462230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:07.462944 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:07.469750 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:07.470228 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:07.471251 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:07.471672 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:07.488678 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] HTTP exception thrown: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Request method failure captured: Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e HTTP/1.1 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFYt9lessjzdW5974lRQ6RFLgIkMHXq37DhocnO0UWZmxgH1_xoTj5X7T_iskRTUyV5mVHWzYFGKb1wioVLsfZtZo04RLq6hglRBwlsFsosSk0ahccKKanegkrHIJjOy-3ovf5UByQMgtkw2yVENjjD_3ubXcdCoLlj51ynsPiuYMcY Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:20:07.490457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: b7275026b00b4e93bed7682b3ff2525c Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:07.492335 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '9ed05903-9a40-4072-a475-0d9de039da3e'} Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:20:07.493145 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:07.494764 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:07.495991 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Returning 404 to user: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:20:07.495991 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a306d8d7-1508-4edd-84b9-d0ee276b03dc tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 404 len: 111 microversion: 2.20 time: 0.033924 Jun 20 11:20:07.495991 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 475/942] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:20:07 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:20:07.502751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2423142-5cc6-4000-8fc3-0fc4769d3e1c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '.version_select at 0x7f72159a7280>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:07.524931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2423142-5cc6-4000-8fc3-0fc4769d3e1c tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-978548769" status: 204 len: 0 microversion: 2.20 time: 0.026864 Jun 20 11:20:07.525528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 468/943] 10.222.0.33 () {60 vars in 1258 bytes} [Mon Jun 20 11:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-978548769 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 20 11:20:09.609926 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:09.610566 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:09.617779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:09.618259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:09.619026 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:09.619458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:09.637277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] HTTP exception thrown: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Request method failure captured: Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e HTTP/1.1 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFYt9lessjzdW5974lRQ6RFLgIkMHXq37DhocnO0UWZmxgH1_xoTj5X7T_iskRTUyV5mVHWzYFGKb1wioVLsfZtZo04RLq6hglRBwlsFsosSk0ahccKKanegkrHIJjOy-3ovf5UByQMgtkw2yVENjjD_3ubXcdCoLlj51ynsPiuYMcY Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:20:09.639070 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: b7275026b00b4e93bed7682b3ff2525c Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.641832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '9ed05903-9a40-4072-a475-0d9de039da3e'} Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:20:09.643579 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.646500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.648621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Returning 404 to user: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:20:09.648621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d6dde7bd-41fa-4ab5-8677-b284e0e11d55 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 404 len: 111 microversion: 2.20 time: 0.034501 Jun 20 11:20:09.648621 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 476/944] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 20 11:20:09 2022] DELETE /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:20:09.652420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:09.654705 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 9ed05903-9a40-4072-a475-0d9de039da3e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:09.664747 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:09.667467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:09.668267 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:09.668704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:09.683490 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] HTTP exception thrown: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Request method failure captured: Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e HTTP/1.1 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFYt9lessjzdW5974lRQ6RFLgIkMHXq37DhocnO0UWZmxgH1_xoTj5X7T_iskRTUyV5mVHWzYFGKb1wioVLsfZtZo04RLq6hglRBwlsFsosSk0ahccKKanegkrHIJjOy-3ovf5UByQMgtkw2yVENjjD_3ubXcdCoLlj51ynsPiuYMcY Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:20:09.685197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: b7275026b00b4e93bed7682b3ff2525c Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.686927 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '9ed05903-9a40-4072-a475-0d9de039da3e'} Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:20:09.687840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. Jun 20 11:20:09.689391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:09.690859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Returning 404 to user: Instance 9ed05903-9a40-4072-a475-0d9de039da3e could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:20:09.690859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8666ce84-c00d-4992-a65b-6dbef76a8c1f tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e" status: 404 len: 111 microversion: 2.20 time: 0.039140 Jun 20 11:20:09.690859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 469/945] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:20:09 2022] GET /compute/v2.1/servers/9ed05903-9a40-4072-a475-0d9de039da3e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:20:10.855253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:10.855836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:10.862617 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:10.863036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:10.864636 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:10.864984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:10.879386 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] HTTP exception thrown: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Request method failure captured: Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 HTTP/1.1 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFYt9lessjzdW5974lRQ6RFLgIkMHXq37DhocnO0UWZmxgH1_xoTj5X7T_iskRTUyV5mVHWzYFGKb1wioVLsfZtZo04RLq6hglRBwlsFsosSk0ahccKKanegkrHIJjOy-3ovf5UByQMgtkw2yVENjjD_3ubXcdCoLlj51ynsPiuYMcY Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:20:10.880969 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: b7275026b00b4e93bed7682b3ff2525c Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.882709 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '83d13cd6-1aed-40e5-94b0-7b0ce9e863b4'} Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:20:10.883653 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.885217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.886809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Returning 404 to user: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:20:10.886809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ebaec750-6bca-4ead-ad8e-7e8a1d46f4e7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 404 len: 111 microversion: 2.20 time: 0.031216 Jun 20 11:20:10.886809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 477/946] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 20 11:20:10 2022] DELETE /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:20:10.891214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:10.891824 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] [instance: 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:10.898986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:10.899435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:10.900310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:10.901666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:10.915612 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] HTTP exception thrown: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Request method failure captured: Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 HTTP/1.1 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFYt9lessjzdW5974lRQ6RFLgIkMHXq37DhocnO0UWZmxgH1_xoTj5X7T_iskRTUyV5mVHWzYFGKb1wioVLsfZtZo04RLq6hglRBwlsFsosSk0ahccKKanegkrHIJjOy-3ovf5UByQMgtkw2yVENjjD_3ubXcdCoLlj51ynsPiuYMcY Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:20:10.917193 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5778b58ba0bb4bebb334d08971c67323"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 5778b58ba0bb4bebb334d08971c67323 Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1293895855 Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: b7275026b00b4e93bed7682b3ff2525c Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1293895855-project Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.918959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '83d13cd6-1aed-40e5-94b0-7b0ce9e863b4'} Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:20:10.919727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. Jun 20 11:20:10.921001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:20:10.922379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] Returning 404 to user: Instance 83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:20:10.922379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5e98b1e5-96de-43fd-aa8e-20a8e6e5bde7 tempest-AttachVolumeShelveTestJSON-1293895855 tempest-AttachVolumeShelveTestJSON-1293895855-project] 10.222.0.33 "GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4" status: 404 len: 111 microversion: 2.20 time: 0.031383 Jun 20 11:20:10.922379 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 470/947] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 20 11:20:10 2022] GET /compute/v2.1/servers/83d13cd6-1aed-40e5-94b0-7b0ce9e863b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:20:19.780962 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4a14355f-06c2-44bb-bd7c-ad6a350ba583 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: .version_select at 0x7f7215030550>, body: {"keypair": {"name": "tempest-keypair-1713041676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0oZDTIgj5wXFRZFK6UBdHipROMPUyDMoK+SjhQFMieaQtmU4bAn8/eTSbHcq1QiNpx/KIItvUSftzc1qlSLiUFIR2jDUPGx+2uG+hSIGfdFN4HSNIjtVuVkchrTHnUww=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:20:19.796739 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-4a14355f-06c2-44bb-bd7c-ad6a350ba583 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:20:19.802598 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-4a14355f-06c2-44bb-bd7c-ad6a350ba583 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:20:19.837943 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4a14355f-06c2-44bb-bd7c-ad6a350ba583 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183614 Jun 20 11:20:19.839532 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 478/948] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:20:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:20:21.302490 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1286181021", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96e751e1-d8e4-44ba-83ca-0c256bdfc3d9"}], "security_groups": [{"name": "tempest-securitygroup--418122067"}], "key_name": "tempest-keypair-1713041676", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:20:21.310308 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:21.310959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:21.415279 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] validate_networks() for [('96e751e1-d8e4-44ba-83ca-0c256bdfc3d9', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:20:21.814543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:20:21.814961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:20:21.815419 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:20:21.815828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:20:21.816234 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:20:21.836586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:21.837028 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:21.838120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:21.838540 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:21.856953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:20:21.861302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:20:21.873788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:20:21.876414 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:20:21.938081 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0f8e5679-1f0f-461a-9c57-2d1d992275af tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.640141 Jun 20 11:20:21.939458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 471/949] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:20:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:20:21.949796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dc420d28-3f9a-4a7a-a993-87b4ba3adecd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:21.951055 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dc420d28-3f9a-4a7a-a993-87b4ba3adecd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:21.958433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=24 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:22.019066 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dc420d28-3f9a-4a7a-a993-87b4ba3adecd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:22.026728 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dc420d28-3f9a-4a7a-a993-87b4ba3adecd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1242 microversion: 2.1 time: 0.080882 Jun 20 11:20:22.037062 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 479/950] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:21 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:23.052172 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:23.053654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:23.064100 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:23.066362 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:23.067594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:23.069593 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:23.186550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:23.196609 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-69fb2f9c-e007-4800-be76-14fada320754 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1302 microversion: 2.1 time: 0.153353 Jun 20 11:20:23.197303 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 472/951] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:23 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:24.214431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:24.215432 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:24.222941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:24.223706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:24.224892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:24.225498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:24.366266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:24.374331 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-226ab8f2-643d-43f7-83cd-cc087bb0a416 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.163892 Jun 20 11:20:24.374916 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 480/952] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:24 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:24.620218 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-cecf2cf6-202f-4e7b-9fff-72c9e96bb6dd req-b68f82ce-5708-4ef0-8363-be3d0eb33562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b7e6fbc-2ee7-4634-b66d-2739811d133f", "tag": "32b81369-6a0c-4869-830e-4b810c51f2fe"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:20:24.630864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-cecf2cf6-202f-4e7b-9fff-72c9e96bb6dd req-b68f82ce-5708-4ef0-8363-be3d0eb33562 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:24.631570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-cecf2cf6-202f-4e7b-9fff-72c9e96bb6dd req-b68f82ce-5708-4ef0-8363-be3d0eb33562 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:24.647309 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-cecf2cf6-202f-4e7b-9fff-72c9e96bb6dd req-b68f82ce-5708-4ef0-8363-be3d0eb33562 service nova] Creating event network-changed:32b81369-6a0c-4869-830e-4b810c51f2fe for instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f on hv-cinder-84614 Jun 20 11:20:24.652908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-cecf2cf6-202f-4e7b-9fff-72c9e96bb6dd req-b68f82ce-5708-4ef0-8363-be3d0eb33562 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036169 Jun 20 11:20:24.653435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 473/953] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:20:25.392961 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:25.393547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:25.400965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:25.401414 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:25.402221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:25.402656 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:25.795841 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:25.804537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-87313c05-d132-4e53-a073-7dc1435f49d8 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.415374 Jun 20 11:20:25.805499 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 481/954] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:25 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:26.823396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:26.824009 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:26.830889 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:26.831341 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:26.832124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:26.832774 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:26.969174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:26.977646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-61675c99-ae55-48b7-8dce-ddcbec1fc90f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.159115 Jun 20 11:20:26.978274 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 474/955] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:26 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:27.999022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:28.000022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:28.008954 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:28.009431 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:28.010320 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:28.010761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:28.144584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:28.152416 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0b8a99d4-37ff-4d0a-b573-a1bf2d97a079 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.160126 Jun 20 11:20:28.152973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 482/956] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:27 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:29.170497 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:29.171163 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:29.178537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:29.179002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:29.180152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:29.180587 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:29.328864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:29.337709 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb1ce385-311b-41c8-9fea-3ec6d83a98c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.171352 Jun 20 11:20:29.338451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 475/957] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:29 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:30.356704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:30.357324 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:30.364676 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:30.365148 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:30.365945 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:30.366393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:30.534643 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:30.544470 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2670c8fe-8ab1-47ac-9520-186538d10015 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.192703 Jun 20 11:20:30.545073 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 483/958] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:30 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:31.018504 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-8238ab88-876a-4cae-9694-5678e4f09034 req-94976909-caad-402c-b93f-85dcadd1175f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7e6fbc-2ee7-4634-b66d-2739811d133f", "name": "network-vif-plugged", "status": "completed", "tag": "32b81369-6a0c-4869-830e-4b810c51f2fe"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:20:31.027124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8238ab88-876a-4cae-9694-5678e4f09034 req-94976909-caad-402c-b93f-85dcadd1175f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:31.027606 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8238ab88-876a-4cae-9694-5678e4f09034 req-94976909-caad-402c-b93f-85dcadd1175f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:31.041217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-8238ab88-876a-4cae-9694-5678e4f09034 req-94976909-caad-402c-b93f-85dcadd1175f service nova] Creating event network-vif-plugged:32b81369-6a0c-4869-830e-4b810c51f2fe for instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f on hv-cinder-84614 Jun 20 11:20:31.046519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-8238ab88-876a-4cae-9694-5678e4f09034 req-94976909-caad-402c-b93f-85dcadd1175f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032640 Jun 20 11:20:31.047141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 476/959] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:20:31.562615 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:31.563553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:31.571159 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:31.571600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:31.572368 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:31.572825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:31.719960 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:31.729250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c58f6674-0446-4440-9394-78d0e66986d0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.171685 Jun 20 11:20:31.729973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 484/960] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:31 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:32.753053 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:32.753956 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:32.761150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:32.762135 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:32.771891 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:32.772343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:32.773146 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:32.773583 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:32.912656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:32.924234 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36f78d1b-fd39-430a-8164-2f0b2baab8d9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1367 microversion: 2.1 time: 0.172953 Jun 20 11:20:32.924827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 477/961] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:32 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:33.941403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:33.942021 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:33.944092 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:33.945323 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:20:33.952193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:33.952685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:33.953447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:33.953877 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:34.096868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:20:34.104685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-02302295-ae1c-4949-96dc-996341adf959 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1555 microversion: 2.1 time: 0.167270 Jun 20 11:20:34.105218 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 485/962] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:20:33 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:20:34.120834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:20:34.121363 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:20:34.127905 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:34.128348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:34.129111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:34.129538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:34.212924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-36dbcee5-cd8a-40a4-8f6a-607e3b500add tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095877 Jun 20 11:20:34.213524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 478/963] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:20:34 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:20:35.495801 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-16dcc8fa-b4d2-4d48-9aba-c5516eb4d881 req-58fe889b-2738-4a87-a90a-94a8e2900674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b7e6fbc-2ee7-4634-b66d-2739811d133f", "tag": "32b81369-6a0c-4869-830e-4b810c51f2fe"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:20:35.504664 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-16dcc8fa-b4d2-4d48-9aba-c5516eb4d881 req-58fe889b-2738-4a87-a90a-94a8e2900674 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:20:35.505102 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-16dcc8fa-b4d2-4d48-9aba-c5516eb4d881 req-58fe889b-2738-4a87-a90a-94a8e2900674 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:20:35.516609 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-16dcc8fa-b4d2-4d48-9aba-c5516eb4d881 req-58fe889b-2738-4a87-a90a-94a8e2900674 service nova] Creating event network-changed:32b81369-6a0c-4869-830e-4b810c51f2fe for instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f on hv-cinder-84614 Jun 20 11:20:35.521825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-16dcc8fa-b4d2-4d48-9aba-c5516eb4d881 req-58fe889b-2738-4a87-a90a-94a8e2900674 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029659 Jun 20 11:20:35.522650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 486/964] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:21:22.630506 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:21:22.631257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:21:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:21:39.928243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:21:39.929494 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:21:39.935226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:39.935929 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:39.943229 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:39.943674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:39.944439 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:39.944878 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:39.970579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f99304c8-645f-4845-9750-143e328c7c76 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/ips" status: 200 len: 148 microversion: 2.1 time: 0.045282 Jun 20 11:21:39.971150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 479/965] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:21:39 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:21:41.349162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:21:41.349894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=38 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:21:41.354464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72dabb45-2296-4ab5-be43-d27ab74b8a99"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:21:41.355597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:41.362754 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:41.363197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:41.363940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:41.364366 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:41.630026 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-038dc4e9-a385-45b6-8761-cd7adb1ebcd0 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282783 Jun 20 11:21:41.630667 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 487/966] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:21:41 2022] POST /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:21:49.182534 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d18b78a9-7db4-4b33-bdaf-5eb558ecc967 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: .version_select at 0x7f7215950940>, body: {"keypair": {"name": "tempest-keypair-1902044820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVVa2l/0jno+VPsJY35sfLD5S+42BnuhHsVjSR0mm3xu9bF9DJvV8ZeHRqaSWp6iCxxotxeoKBylSEPzH+i2eUOmVktvQBbxCMyQyzeV6V+DM/BsjRS1/dgBqOcsm1+fw=="}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:21:49.198242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-d18b78a9-7db4-4b33-bdaf-5eb558ecc967 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:21:49.202549 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-d18b78a9-7db4-4b33-bdaf-5eb558ecc967 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:21:49.234219 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d18b78a9-7db4-4b33-bdaf-5eb558ecc967 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055764 Jun 20 11:21:49.235138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 480/967] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:21:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:21:50.568498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-615291401", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96e751e1-d8e4-44ba-83ca-0c256bdfc3d9"}], "security_groups": [{"name": "tempest-securitygroup--1795904649"}], "key_name": "tempest-keypair-1902044820", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:21:50.683192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] validate_networks() for [('96e751e1-d8e4-44ba-83ca-0c256bdfc3d9', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:21:51.124861 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:21:51.125213 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:21:51.125682 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:21:51.126125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:21:51.126525 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:21:51.136257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:51.136705 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:51.137494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:51.137930 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:51.155259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:21:51.159325 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:21:51.170625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:21:51.172984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:21:51.228105 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5b401048-12b4-480a-a6a7-c53f47feedb9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664633 Jun 20 11:21:51.228713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 488/968] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:21:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:21:51.236225 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=4 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:21:51.241098 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4e140a1c-6ce6-444f-8d47-0effedfb41e4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:51.241702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4e140a1c-6ce6-444f-8d47-0effedfb41e4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:51.297213 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4e140a1c-6ce6-444f-8d47-0effedfb41e4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:51.305041 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4e140a1c-6ce6-444f-8d47-0effedfb41e4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1241 microversion: 2.1 time: 0.069527 Jun 20 11:21:51.306751 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 481/969] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:51 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:52.323006 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:52.323853 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:52.332825 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:52.333333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:52.334455 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:52.335260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:52.402028 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:52.409839 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-09e9195c-e4f9-4fc4-9515-22843f837d95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1299 microversion: 2.1 time: 0.090726 Jun 20 11:21:52.410418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 489/970] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:52 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:21:53.427381 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:53.428080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:53.435805 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:53.436233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:53.437039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:53.437467 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:53.627619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:53.635903 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9716b360-d86a-4fd4-ae9b-72798ba83679 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.212400 Jun 20 11:21:53.636795 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 482/971] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:53 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:53.803084 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-d9549fc5-0547-471d-aa0d-dac8cc52df57 req-f886c1da-6781-4937-aa80-e0badbbc2c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f8df54-735e-403e-9a9f-8cceaa167d4e", "tag": "613462bd-1476-4e5f-97c4-5d70df6f9e9a"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:21:53.820622 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d9549fc5-0547-471d-aa0d-dac8cc52df57 req-f886c1da-6781-4937-aa80-e0badbbc2c5f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:53.821074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d9549fc5-0547-471d-aa0d-dac8cc52df57 req-f886c1da-6781-4937-aa80-e0badbbc2c5f service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:53.835583 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-d9549fc5-0547-471d-aa0d-dac8cc52df57 req-f886c1da-6781-4937-aa80-e0badbbc2c5f service nova] Creating event network-changed:613462bd-1476-4e5f-97c4-5d70df6f9e9a for instance f9f8df54-735e-403e-9a9f-8cceaa167d4e on hv-cinder-84614 Jun 20 11:21:53.841277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-d9549fc5-0547-471d-aa0d-dac8cc52df57 req-f886c1da-6781-4937-aa80-e0badbbc2c5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120631 Jun 20 11:21:53.842003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 490/972] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:21:54.653780 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:54.654535 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:54.661582 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:54.662032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:54.662828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:54.663254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:54.800633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:54.813615 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4df06424-11d8-40ce-af5e-1b54e2bbcc62 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.163908 Jun 20 11:21:54.814744 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 483/973] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:54 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:55.831980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:55.832669 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:55.839775 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:55.840212 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:55.840968 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:55.841412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:55.980380 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:55.992509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e25fcdd8-528c-410d-93f3-d8dd1c216178 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.164795 Jun 20 11:21:55.993412 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 491/974] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:55 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:57.014706 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:57.015317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:57.022876 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:57.023339 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:57.024092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:57.024516 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:57.174998 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:57.183046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c3a48393-e1e2-43bf-9235-8530df4d2bb2 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.174355 Jun 20 11:21:57.183620 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 484/975] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:57 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:58.202661 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:58.203377 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:58.212747 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:58.213347 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:58.214418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:58.214977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:58.362950 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:58.371129 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c89e5c9c-314d-4ce4-8870-bc6f1cb1e0b4 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.173895 Jun 20 11:21:58.371704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 492/976] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:58 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:59.393734 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:21:59.394376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:21:59.401210 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:59.401661 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:59.402529 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:59.402959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:59.534189 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:21:59.541915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-3abf7354-7313-4aa1-ac2a-d865fa67404d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.152117 Jun 20 11:21:59.542550 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 485/977] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:21:59 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:21:59.785373 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-ec1a1ad1-3714-4c77-a6c3-4336b0244d19 req-86967687-a7ce-43ff-9709-af9a3a352592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f8df54-735e-403e-9a9f-8cceaa167d4e", "name": "network-vif-plugged", "status": "completed", "tag": "613462bd-1476-4e5f-97c4-5d70df6f9e9a"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:21:59.794160 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ec1a1ad1-3714-4c77-a6c3-4336b0244d19 req-86967687-a7ce-43ff-9709-af9a3a352592 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:21:59.794599 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ec1a1ad1-3714-4c77-a6c3-4336b0244d19 req-86967687-a7ce-43ff-9709-af9a3a352592 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:21:59.806877 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-ec1a1ad1-3714-4c77-a6c3-4336b0244d19 req-86967687-a7ce-43ff-9709-af9a3a352592 service nova] Creating event network-vif-plugged:613462bd-1476-4e5f-97c4-5d70df6f9e9a for instance f9f8df54-735e-403e-9a9f-8cceaa167d4e on hv-cinder-84614 Jun 20 11:21:59.811904 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-ec1a1ad1-3714-4c77-a6c3-4336b0244d19 req-86967687-a7ce-43ff-9709-af9a3a352592 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090480 Jun 20 11:21:59.812496 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 493/978] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:22:00.561285 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:22:00.562019 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:22:00.570792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:00.571382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:00.572318 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:00.572855 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:00.715822 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:22:00.727892 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fb6297b5-da19-4530-94d5-f68dcc12ae0c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1367 microversion: 2.1 time: 0.171127 Jun 20 11:22:00.728793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 486/979] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:22:00 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:22:01.748243 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:22:01.749194 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:22:01.755018 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:22:01.755731 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:22:01.762909 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:01.763359 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:01.764120 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:01.764560 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:01.918780 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:22:01.927085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bbfffc7b-da39-4d18-bcf7-d1d07d10f73b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1556 microversion: 2.1 time: 0.181306 Jun 20 11:22:01.927810 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 494/980] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:22:01 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:22:01.944047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:22:01.944586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:22:01.946669 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:22:01.951945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:01.952395 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:01.953155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:01.953584 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:02.031513 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-f6dbad7d-13aa-48d3-97d0-8bea4e8d1185 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091612 Jun 20 11:22:02.032097 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 487/981] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:22:01 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:22:03.009457 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-5f30513a-6757-4a68-bf94-2fae24c2944e req-a551dbd4-4b91-4769-a7b2-841bceecad50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f8df54-735e-403e-9a9f-8cceaa167d4e", "tag": "613462bd-1476-4e5f-97c4-5d70df6f9e9a"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:22:03.018261 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-5f30513a-6757-4a68-bf94-2fae24c2944e req-a551dbd4-4b91-4769-a7b2-841bceecad50 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:22:03.018706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-5f30513a-6757-4a68-bf94-2fae24c2944e req-a551dbd4-4b91-4769-a7b2-841bceecad50 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:22:03.030535 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-5f30513a-6757-4a68-bf94-2fae24c2944e req-a551dbd4-4b91-4769-a7b2-841bceecad50 service nova] Creating event network-changed:613462bd-1476-4e5f-97c4-5d70df6f9e9a for instance f9f8df54-735e-403e-9a9f-8cceaa167d4e on hv-cinder-84614 Jun 20 11:22:03.036608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-5f30513a-6757-4a68-bf94-2fae24c2944e req-a551dbd4-4b91-4769-a7b2-841bceecad50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030841 Jun 20 11:22:03.037413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 495/982] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:22:51.002334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:22:51.003108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:22:52.324197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:22:52.324886 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:23:07.602636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:23:07.603712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=34 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:23:07.610038 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:07.610828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:07.621317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:07.621906 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:07.622727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:07.623164 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:07.647828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c2f2f3dd-66db-4f8b-93fc-de98375cf5b5 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/ips" status: 200 len: 149 microversion: 2.1 time: 0.047823 Jun 20 11:23:07.648401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 488/983] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:23:07 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:07.662388 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:23:07.666036 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:23:07.670965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72dabb45-2296-4ab5-be43-d27ab74b8a99"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:07.672118 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:07.680854 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:07.681301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:07.682069 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:07.682522 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:07.772715 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Invalid volume: volume 72dabb45-2296-4ab5-be43-d27ab74b8a99 is already attached to instances: 5b7e6fbc-2ee7-4634-b66d-2739811d133f Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: POST /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/os-volume_attachments HTTP/1.1 Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 74 Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:23:07.774640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {"volumeAttachment": {"volumeId": "72dabb45-2296-4ab5-be43-d27ab74b8a99"}} Jun 20 11:23:07.776596 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Invalid volume: volume 72dabb45-2296-4ab5-be43-d27ab74b8a99 is already attached to instances: 5b7e6fbc-2ee7-4634-b66d-2739811d133f Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'server_id': 'f9f8df54-735e-403e-9a9f-8cceaa167d4e', 'body': {'volumeAttachment': {'volumeId': '72dabb45-2296-4ab5-be43-d27ab74b8a99'}}} Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72dabb45-2296-4ab5-be43-d27ab74b8a99 is already attached to instances: 5b7e6fbc-2ee7-4634-b66d-2739811d133f Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:07.777847 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72dabb45-2296-4ab5-be43-d27ab74b8a99 is already attached to instances: 5b7e6fbc-2ee7-4634-b66d-2739811d133f Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:07.780326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72dabb45-2296-4ab5-be43-d27ab74b8a99 is already attached to instances: 5b7e6fbc-2ee7-4634-b66d-2739811d133f Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 400 to user: Invalid volume: volume 72dabb45-2296-4ab5-be43-d27ab74b8a99 is already attached to instances: 5b7e6fbc-2ee7-4634-b66d-2739811d133f {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e8b4c33f-0a29-49df-ba09-45123e65b21d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117103 Jun 20 11:23:07.782941 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 496/984] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:23:07 2022] POST /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:23:07.785664 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:07.786509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:07.794129 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:07.794929 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:07.795508 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:07.796113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:07.824041 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:23:07.887512 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR oslo.messaging._drivers.impl_rabbit [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [f532d3b0-68bc-41a4-8613-a8c7c38fa335] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 20 11:23:08.895896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [f532d3b0-68bc-41a4-8613-a8c7c38fa335] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37254. Jun 20 11:23:08.921509 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-443619c5-0242-46df-8d3b-60c4b2cace13 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 204 len: 0 microversion: 2.1 time: 1.139692 Jun 20 11:23:08.922500 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 489/985] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:23:07 2022] DELETE /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:23:08.932787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:08.933406 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:08.940839 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:08.941292 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:08.942051 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:08.942525 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:09.085608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:09.093927 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-05fb276f-fda4-451f-b17d-ca75989d335c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1681 microversion: 2.1 time: 0.166282 Jun 20 11:23:09.094540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 497/986] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:08 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:10.115881 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:10.116605 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:10.126421 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:10.127103 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:10.128309 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:10.128953 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:10.273442 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:10.281429 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ab8fc29b-ade8-4a2b-b3a6-7ec6183b76db tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1681 microversion: 2.1 time: 0.171968 Jun 20 11:23:10.281976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 490/987] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:10 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:11.299379 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:11.299970 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:11.307767 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:11.308141 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:11.308972 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:11.309490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:11.376287 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:11.384796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d839b268-dac8-46c7-a054-4dc4e52d0ffe tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 200 len: 1613 microversion: 2.1 time: 0.089497 Jun 20 11:23:11.385981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 498/988] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:11 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:11.785124 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a373a18e-fe30-4b8f-a3a9-41f4ed8a9fa2 req-a6b684c2-48ed-4ce7-8816-75f0c4c32331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f8df54-735e-403e-9a9f-8cceaa167d4e", "name": "network-vif-deleted", "tag": "613462bd-1476-4e5f-97c4-5d70df6f9e9a"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:11.797302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a373a18e-fe30-4b8f-a3a9-41f4ed8a9fa2 req-a6b684c2-48ed-4ce7-8816-75f0c4c32331 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:11.798315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a373a18e-fe30-4b8f-a3a9-41f4ed8a9fa2 req-a6b684c2-48ed-4ce7-8816-75f0c4c32331 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:11.811371 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a373a18e-fe30-4b8f-a3a9-41f4ed8a9fa2 req-a6b684c2-48ed-4ce7-8816-75f0c4c32331 service nova] Creating event network-vif-deleted:613462bd-1476-4e5f-97c4-5d70df6f9e9a for instance f9f8df54-735e-403e-9a9f-8cceaa167d4e on hv-cinder-84614 Jun 20 11:23:11.818031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a373a18e-fe30-4b8f-a3a9-41f4ed8a9fa2 req-a6b684c2-48ed-4ce7-8816-75f0c4c32331 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036476 Jun 20 11:23:11.818882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 491/989] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:12.405131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:12.405719 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:12.414550 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:12.415085 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:12.416445 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:12.416896 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:12.431344 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e HTTP/1.1 Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:23:12.433317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:23:12.434771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'f9f8df54-735e-403e-9a9f-8cceaa167d4e'} Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:23:12.435555 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:23:12.437104 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:12.438580 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:23:12.438580 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-96c2fa89-f842-404d-89e3-0b116f32af93 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 404 len: 111 microversion: 2.1 time: 0.035798 Jun 20 11:23:12.438580 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 499/990] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:12 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:23:12.444458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91638aa5-956b-4bf3-970f-df9f43da9333 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '.version_select at 0x7f7215959c10>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:12.465608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91638aa5-956b-4bf3-970f-df9f43da9333 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902044820" status: 202 len: 0 microversion: 2.1 time: 0.025230 Jun 20 11:23:12.469501 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 492/991] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 20 11:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902044820 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:23:13.190032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:13.190793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:13.199483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:13.199931 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:13.200700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:13.201131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:13.286754 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lazy-loading 'services' on Instance uuid 5b7e6fbc-2ee7-4634-b66d-2739811d133f {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:23:13.378840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d7d7ad76-ac76-45bd-b6b9-1dbc177af826 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments/72dabb45-2296-4ab5-be43-d27ab74b8a99" status: 202 len: 0 microversion: 2.1 time: 0.194214 Jun 20 11:23:13.379515 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 500/992] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:23:13 2022] DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments/72dabb45-2296-4ab5-be43-d27ab74b8a99 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:23:13.388756 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:13.390070 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:13.397139 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:13.397583 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:13.398489 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:13.399031 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:13.428994 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-887b9536-a63b-4e0f-b0ef-da23fa686549 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044949 Jun 20 11:23:13.429563 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 493/993] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:23:13 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:14.442644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:14.443608 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:14.450565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:14.451016 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:14.451785 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:14.452217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:14.484158 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46d97bee-69d3-434d-9587-fd0d7ad64064 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046346 Jun 20 11:23:14.484795 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 501/994] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:23:14 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:23:14.548820 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:14.549519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:14.561131 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:14.561959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:14.563228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:14.563663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:14.593685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:23:14.679109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-190ffd9f-6e89-43ad-97fa-0275da982e26 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 204 len: 0 microversion: 2.1 time: 0.136259 Jun 20 11:23:14.679899 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 494/995] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:23:14 2022] DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:23:14.688719 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:14.689408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:14.697303 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:14.697787 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:14.698925 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:14.699206 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:14.845533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:14.853725 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6491d424-eecc-4276-be77-9650afae4fa1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1680 microversion: 2.1 time: 0.169043 Jun 20 11:23:14.854543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 502/996] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:14 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:15.872672 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:15.873346 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:15.880111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:15.880560 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:15.881315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:15.881743 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:16.021964 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:16.035155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-2af79632-bca4-4e0b-a91c-4ed98ace5f95 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1680 microversion: 2.1 time: 0.166652 Jun 20 11:23:16.036040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 495/997] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:15 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:17.057170 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:17.057759 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:17.064230 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:17.064683 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:17.065425 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:17.065861 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:17.135565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:17.143727 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-18f44fa3-d74f-4e7c-ac99-962f108e0187 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 200 len: 1613 microversion: 2.1 time: 0.091143 Jun 20 11:23:17.144300 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 503/998] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:17 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:17.268681 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-a03e4ae8-65d9-407e-9434-bd1b0b80c26c req-41b8f55a-a39b-4810-b941-f3434c2d8fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b7e6fbc-2ee7-4634-b66d-2739811d133f", "name": "network-vif-deleted", "tag": "32b81369-6a0c-4869-830e-4b810c51f2fe"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:17.278065 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a03e4ae8-65d9-407e-9434-bd1b0b80c26c req-41b8f55a-a39b-4810-b941-f3434c2d8fc0 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:17.278896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-a03e4ae8-65d9-407e-9434-bd1b0b80c26c req-41b8f55a-a39b-4810-b941-f3434c2d8fc0 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:17.304404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-a03e4ae8-65d9-407e-9434-bd1b0b80c26c req-41b8f55a-a39b-4810-b941-f3434c2d8fc0 service nova] Creating event network-vif-deleted:32b81369-6a0c-4869-830e-4b810c51f2fe for instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f on hv-cinder-84614 Jun 20 11:23:17.309695 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-a03e4ae8-65d9-407e-9434-bd1b0b80c26c req-41b8f55a-a39b-4810-b941-f3434c2d8fc0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044658 Jun 20 11:23:17.310587 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 496/999] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:18.161481 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:18.162002 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:18.169022 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:18.169999 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:18.170829 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:18.171255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:18.186189 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f HTTP/1.1 Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:23:18.187796 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:23:18.189352 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '5b7e6fbc-2ee7-4634-b66d-2739811d133f'} Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:23:18.190348 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:23:18.191876 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:23:18.193405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:23:18.193405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5bd3ebe0-fc77-44ce-844b-043798ac6836 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 404 len: 111 microversion: 2.1 time: 0.032109 Jun 20 11:23:18.193405 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 504/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:18 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:23:18.199738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-0c88f918-363e-4644-9aaf-e26c1782adcc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '.version_select at 0x7f72159625e0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:18.221361 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-0c88f918-363e-4644-9aaf-e26c1782adcc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713041676" status: 202 len: 0 microversion: 2.1 time: 0.026299 Jun 20 11:23:18.222046 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 497/1001] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 20 11:23:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713041676 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:23:18.895483 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1098601e-f434-409b-b614-5ff7d29ac133 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: .version_select at 0x7f721502d940>, body: {"keypair": {"name": "tempest-keypair-2139594680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO51nTng5nrNvSEVxDFtoGsXfnO/4cwQSsMIvTufSf+ixqN6iVGEBeq2Ur4zrR/7NpM2NALJLl4QDsMBQVcpJT9S2tRUNakgLOeKBuac/XlNg7xXhZIqYSTiTZiGochmSQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:18.910472 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1098601e-f434-409b-b614-5ff7d29ac133 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:23:18.914562 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1098601e-f434-409b-b614-5ff7d29ac133 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:23:18.942427 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1098601e-f434-409b-b614-5ff7d29ac133 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050890 Jun 20 11:23:18.943024 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 505/1002] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:23:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:20.273602 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-924000763", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96e751e1-d8e4-44ba-83ca-0c256bdfc3d9"}], "security_groups": [{"name": "tempest-securitygroup--809229059"}], "key_name": "tempest-keypair-2139594680", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:20.387463 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] validate_networks() for [('96e751e1-d8e4-44ba-83ca-0c256bdfc3d9', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:23:20.833727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:23:20.834268 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:23:20.834739 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:23:20.835147 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:23:20.835552 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:23:20.844983 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:20.845431 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:20.846355 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:20.846792 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:20.864195 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:23:20.868517 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:23:20.880523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:23:20.882899 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:23:20.933002 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c68f6054-69c8-4ab2-8ca5-380ff576cb4d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.666248 Jun 20 11:23:20.933635 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 498/1003] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:23:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:23:20.944510 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fa1774fb-e266-4766-9267-4cba5f7ef0b3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:20.945128 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fa1774fb-e266-4766-9267-4cba5f7ef0b3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:21.001454 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fa1774fb-e266-4766-9267-4cba5f7ef0b3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:21.009445 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fa1774fb-e266-4766-9267-4cba5f7ef0b3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1241 microversion: 2.1 time: 0.069294 Jun 20 11:23:21.010409 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 506/1004] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:20 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:22.028629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:22.029391 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:22.036699 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:22.037153 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:22.038152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:22.038596 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:22.118366 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:22.126473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-fdfa4f12-083e-4495-b2b0-12a2018b09de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1311 microversion: 2.1 time: 0.102526 Jun 20 11:23:22.127047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 499/1005] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:22 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:23.144334 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:23.145474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:23.158232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:23.158232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:23.158232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:23.158232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:23.303543 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:23.311469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-249e9837-74fe-4dba-9a30-041e617f15cf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1366 microversion: 2.1 time: 0.171422 Jun 20 11:23:23.312468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 507/1006] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:23 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:23.460214 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-6ebb1b71-bbd7-4155-bd21-4843dba0a0d5 req-4f077d42-5f7f-4505-bb6c-8ab24a52dac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd", "tag": "22a11737-693d-46b1-95ec-6bd3ec06f15c"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:23.471195 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6ebb1b71-bbd7-4155-bd21-4843dba0a0d5 req-4f077d42-5f7f-4505-bb6c-8ab24a52dac7 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:23.471553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-6ebb1b71-bbd7-4155-bd21-4843dba0a0d5 req-4f077d42-5f7f-4505-bb6c-8ab24a52dac7 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:23.492807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-6ebb1b71-bbd7-4155-bd21-4843dba0a0d5 req-4f077d42-5f7f-4505-bb6c-8ab24a52dac7 service nova] Creating event network-changed:22a11737-693d-46b1-95ec-6bd3ec06f15c for instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd on hv-cinder-84614 Jun 20 11:23:23.498613 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-6ebb1b71-bbd7-4155-bd21-4843dba0a0d5 req-4f077d42-5f7f-4505-bb6c-8ab24a52dac7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042498 Jun 20 11:23:23.499943 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 500/1007] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:24.331404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:24.332010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:24.338784 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:24.339229 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:24.339983 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:24.340411 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:24.487075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:24.497832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-19e9a9d3-6feb-4e38-b12b-21d8cf5f506c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1366 microversion: 2.1 time: 0.171321 Jun 20 11:23:24.498906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 508/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:24 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:25.518354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:25.519060 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:25.525864 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:25.526340 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:25.527109 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:25.527543 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:25.668570 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:25.679320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eee209c0-0a7d-4dc0-b4b2-9ec0be728be9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1366 microversion: 2.1 time: 0.167370 Jun 20 11:23:25.679911 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 501/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:25 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:26.697730 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:26.698333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:26.705851 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:26.706419 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:26.707216 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:26.707691 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:26.843248 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:26.855408 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1b599977-8faf-437b-820d-3297f5169e58 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1366 microversion: 2.1 time: 0.161850 Jun 20 11:23:26.856326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 509/1010] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:26 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:27.878788 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:27.879373 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:27.886627 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:27.887072 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:27.887854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:27.888286 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:28.025703 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:28.033692 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-80f32427-7829-4557-a413-288280e7201b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1366 microversion: 2.1 time: 0.159125 Jun 20 11:23:28.034293 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 502/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:27 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:28.073285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-83dbe9f3-9136-469c-ae9f-5ce8762b62fb req-ef8b8757-6a37-40aa-8c3e-a54dbe6f1da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd", "name": "network-vif-plugged", "status": "completed", "tag": "22a11737-693d-46b1-95ec-6bd3ec06f15c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:28.082514 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-83dbe9f3-9136-469c-ae9f-5ce8762b62fb req-ef8b8757-6a37-40aa-8c3e-a54dbe6f1da7 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:28.083329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-83dbe9f3-9136-469c-ae9f-5ce8762b62fb req-ef8b8757-6a37-40aa-8c3e-a54dbe6f1da7 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:28.095393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-83dbe9f3-9136-469c-ae9f-5ce8762b62fb req-ef8b8757-6a37-40aa-8c3e-a54dbe6f1da7 service nova] Creating event network-vif-plugged:22a11737-693d-46b1-95ec-6bd3ec06f15c for instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd on hv-cinder-84614 Jun 20 11:23:28.101735 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-83dbe9f3-9136-469c-ae9f-5ce8762b62fb req-ef8b8757-6a37-40aa-8c3e-a54dbe6f1da7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Jun 20 11:23:28.102388 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 510/1012] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:29.051323 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:29.052752 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:29.059851 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:29.060290 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:29.061042 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:29.061464 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:29.201451 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:29.210395 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-854dcff8-752e-4877-98cf-670988818161 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1366 microversion: 2.1 time: 0.162966 Jun 20 11:23:29.210940 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 503/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:29 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:30.233402 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:30.233967 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:30.241118 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:30.241650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:30.242638 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:30.243074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:30.386858 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:23:30.397007 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5b5fc485-afcc-4dbc-80c8-c4868a5a5cef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1554 microversion: 2.1 time: 0.168493 Jun 20 11:23:30.397791 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 511/1014] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:23:30 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:23:30.419836 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:23:30.420449 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:23:30.427372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:30.427817 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:30.428575 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:30.429085 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:30.509657 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1e1181d5-a3df-4414-8dab-980c6a17b638 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094135 Jun 20 11:23:30.510283 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 504/1015] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:23:30 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:23:31.466371 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-da9a08c5-24e0-4ca0-a02f-672522fe8bef req-edce6533-24f5-41ed-8562-cfd84a5755ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd", "tag": "22a11737-693d-46b1-95ec-6bd3ec06f15c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:23:31.470172 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:23:31.476476 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-da9a08c5-24e0-4ca0-a02f-672522fe8bef req-edce6533-24f5-41ed-8562-cfd84a5755ae service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:23:31.477001 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-da9a08c5-24e0-4ca0-a02f-672522fe8bef req-edce6533-24f5-41ed-8562-cfd84a5755ae service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:23:31.488959 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-da9a08c5-24e0-4ca0-a02f-672522fe8bef req-edce6533-24f5-41ed-8562-cfd84a5755ae service nova] Creating event network-changed:22a11737-693d-46b1-95ec-6bd3ec06f15c for instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd on hv-cinder-84614 Jun 20 11:23:31.495990 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-da9a08c5-24e0-4ca0-a02f-672522fe8bef req-edce6533-24f5-41ed-8562-cfd84a5755ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033575 Jun 20 11:23:31.496919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 512/1016] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:24:36.133241 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:24:36.134205 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:24:36.135895 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:24:36.136762 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:24:36.142524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:36.143012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:36.153263 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:36.153716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:36.154527 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:36.154958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:36.197104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c1327961-0528-4679-948d-0320b115c003 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/ips" status: 200 len: 147 microversion: 2.1 time: 0.065073 Jun 20 11:24:36.197652 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 505/1017] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:24:36 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/ips => generated 147 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:24:37.531627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:24:37.532650 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:24:37.537277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4563dd-037a-4be6-b2e2-d0911da12c97"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:24:37.538456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:37.546393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:37.546836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:37.547599 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:37.548032 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:37.795802 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-085f61d0-ab0d-4e93-8f4e-93f6ae8f30c1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266031 Jun 20 11:24:37.796447 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 513/1018] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:24:37 2022] POST /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:24:42.639491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:24:42.640198 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:24:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:24:45.335058 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4563dd-037a-4be6-b2e2-d0911da12c97"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:24:45.336171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:45.342946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:45.343393 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:45.344168 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:45.344600 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:45.426414 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Invalid volume: volume 2b4563dd-037a-4be6-b2e2-d0911da12c97 is already attached to instances: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments HTTP/1.1 Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 74 Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:24:45.428328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {"volumeAttachment": {"volumeId": "2b4563dd-037a-4be6-b2e2-d0911da12c97"}} Jun 20 11:24:45.430138 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Invalid volume: volume 2b4563dd-037a-4be6-b2e2-d0911da12c97 is already attached to instances: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'server_id': '5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd', 'body': {'volumeAttachment': {'volumeId': '2b4563dd-037a-4be6-b2e2-d0911da12c97'}}} Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2b4563dd-037a-4be6-b2e2-d0911da12c97 is already attached to instances: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:24:45.431092 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2b4563dd-037a-4be6-b2e2-d0911da12c97 is already attached to instances: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:24:45.432766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2b4563dd-037a-4be6-b2e2-d0911da12c97 is already attached to instances: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 400 to user: Invalid volume: volume 2b4563dd-037a-4be6-b2e2-d0911da12c97 is already attached to instances: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e9f14ef4-d0fe-4edb-bdc7-a4b30eab7f1a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099758 Jun 20 11:24:45.434325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 506/1019] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:24:45 2022] POST /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:24:45.500081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:45.500687 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:45.508125 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:45.508564 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:45.509432 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:45.509760 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:45.600329 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lazy-loading 'services' on Instance uuid 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:24:45.679508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8a8fe1d3-a1a9-41d8-a7e0-3a43112608c7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments/2b4563dd-037a-4be6-b2e2-d0911da12c97" status: 202 len: 0 microversion: 2.1 time: 0.184146 Jun 20 11:24:45.680142 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 514/1020] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:24:45 2022] DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments/2b4563dd-037a-4be6-b2e2-d0911da12c97 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:24:45.690158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:45.691402 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:45.703039 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:45.703638 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:45.704767 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:45.705301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:45.740772 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1d23b71-ba5f-455e-b33a-c39d6019b6ef tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055854 Jun 20 11:24:45.741349 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 507/1021] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:24:45 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:24:46.755448 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:46.756665 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:46.764188 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:46.764616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:46.765403 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:46.765809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:46.795855 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a401b2fe-1c54-452e-b2cb-af48653f26bf tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044954 Jun 20 11:24:46.796430 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 515/1022] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:24:46 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:24:46.860104 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:46.860785 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:46.868422 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:46.868865 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:46.869656 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:46.870080 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:46.897224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:24:46.985186 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-78894cbf-b232-4fdf-b487-cff751c20600 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 204 len: 0 microversion: 2.1 time: 0.128622 Jun 20 11:24:46.986305 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 508/1023] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:24:46 2022] DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:24:46.995252 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:46.995871 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:47.002333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:47.002784 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:47.003588 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:47.004020 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:47.143746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:47.152192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-00b1f30f-90dc-4c27-aaa8-a97d3180d312 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1678 microversion: 2.1 time: 0.161091 Jun 20 11:24:47.152771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 516/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:46 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:24:48.171758 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:48.172654 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:48.180681 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:48.181126 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:48.181882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:48.182334 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:48.328740 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:48.337217 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e7350b39-4834-44f2-b7f1-3adc2b12ebfc tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1678 microversion: 2.1 time: 0.170516 Jun 20 11:24:48.337808 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 509/1025] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:48 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:49.355360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:49.356261 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:49.364306 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:49.364729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:49.365508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:49.365963 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:49.458508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:49.472604 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b62e383b-ce35-4795-b25d-2fb7c6e63715 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 200 len: 1611 microversion: 2.1 time: 0.120728 Jun 20 11:24:49.473623 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 517/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:49 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 1611 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:49.508269 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-5ca81461-cb79-459c-89cc-cc08b00fd467 req-bc52b5dd-977f-45e7-ab0b-54ff47e4cd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd", "name": "network-vif-deleted", "tag": "22a11737-693d-46b1-95ec-6bd3ec06f15c"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:24:49.527233 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5ca81461-cb79-459c-89cc-cc08b00fd467 req-bc52b5dd-977f-45e7-ab0b-54ff47e4cd10 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:49.528432 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-5ca81461-cb79-459c-89cc-cc08b00fd467 req-bc52b5dd-977f-45e7-ab0b-54ff47e4cd10 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:49.554639 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-5ca81461-cb79-459c-89cc-cc08b00fd467 req-bc52b5dd-977f-45e7-ab0b-54ff47e4cd10 service nova] Creating event network-vif-deleted:22a11737-693d-46b1-95ec-6bd3ec06f15c for instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd on hv-cinder-84614 Jun 20 11:24:49.561222 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-5ca81461-cb79-459c-89cc-cc08b00fd467 req-bc52b5dd-977f-45e7-ab0b-54ff47e4cd10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061610 Jun 20 11:24:49.562833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 510/1027] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:24:50.494129 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:50.495017 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:50.502113 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:50.502549 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:50.504088 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:50.504528 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:50.519820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd HTTP/1.1 Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:24:50.521504 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:24:50.524461 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd'} Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:24:50.525947 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:24:50.528786 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:24:50.531401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:24:50.531401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f51d49e9-0a59-4a30-b3ee-9b22ae77a307 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 404 len: 111 microversion: 2.1 time: 0.033988 Jun 20 11:24:50.531401 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 518/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:50 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:24:50.532515 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-51a52234-4c3d-4c62-91bf-fc39f848ce6e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '.version_select at 0x7f72158d9d30>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:50.553169 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-51a52234-4c3d-4c62-91bf-fc39f848ce6e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139594680" status: 202 len: 0 microversion: 2.1 time: 0.024707 Jun 20 11:24:50.554034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 511/1029] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 20 11:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2139594680 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:24:51.211367 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-95c55b82-10b5-41fc-96df-2e58841fc2e1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: .version_select at 0x7f7215379e50>, body: {"keypair": {"name": "tempest-keypair-645775000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcck/dV1wTGUoMOmCM8y8/QRc7y4HYMowzvqu4Ljx/sMqe7BGD9+tmbmy289zycTnXe3Hrs9mtFEbTBreblOC22ZtWHI9zvbYnEcSvnQxpLRNhosawZO9RDikoCOt6afQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:24:51.226242 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-95c55b82-10b5-41fc-96df-2e58841fc2e1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:24:51.231089 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-95c55b82-10b5-41fc-96df-2e58841fc2e1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:24:51.262239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-95c55b82-10b5-41fc-96df-2e58841fc2e1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054598 Jun 20 11:24:51.263109 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 519/1030] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 20 11:24:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:24:52.510128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1480566492", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96e751e1-d8e4-44ba-83ca-0c256bdfc3d9"}], "security_groups": [{"name": "tempest-securitygroup--1246804698"}], "key_name": "tempest-keypair-645775000", "user_data": "}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:24:52.620266 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] validate_networks() for [('96e751e1-d8e4-44ba-83ca-0c256bdfc3d9', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:24:53.011675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:24:53.012098 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:24:53.012568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:24:53.012981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:24:53.013409 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:24:53.022937 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:53.023387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:53.024187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:53.024627 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:53.042265 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:24:53.046473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Getting quotas for user fb3a76fedfe349cb919d36ee4d688749 and project 90a3abf875c447d7afbd02d79fad4287. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:24:53.058893 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:24:53.061315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:24:53.108551 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6049d79e-2e70-46cc-9054-5c0163b95bab tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.603475 Jun 20 11:24:53.109544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 512/1031] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:24:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:24:53.120172 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5ad70275-7060-442b-956e-c5f8704ad401 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:53.120779 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5ad70275-7060-442b-956e-c5f8704ad401 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:53.192442 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5ad70275-7060-442b-956e-c5f8704ad401 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:53.200060 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5ad70275-7060-442b-956e-c5f8704ad401 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1241 microversion: 2.1 time: 0.084307 Jun 20 11:24:53.200815 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 520/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:53 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:54.219827 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:54.221298 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:54.229799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:54.230301 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:54.231265 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:54.231711 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:54.412496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:54.420436 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-27368d19-2207-4b37-8d70-11177452dd60 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1299 microversion: 2.1 time: 0.205167 Jun 20 11:24:54.421017 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 513/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:54 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:55.440524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:55.441249 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:55.449227 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:55.449767 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:55.451316 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:55.451840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:55.613257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:55.623673 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-38c69838-8383-456c-8148-6664aba5a680 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1367 microversion: 2.1 time: 0.187122 Jun 20 11:24:55.624771 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 521/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:55 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:55.849069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-cdabf23c-6f10-464b-8ee6-5e46fac9aa2f req-58aa44c9-3d29-4f54-bc63-2ef4d89f90f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc77317-f551-45c4-a36f-cd8fa55aca9c", "tag": "15f04419-1f78-43d7-bb50-81c91f98250f"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:24:55.862553 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-cdabf23c-6f10-464b-8ee6-5e46fac9aa2f req-58aa44c9-3d29-4f54-bc63-2ef4d89f90f6 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:55.863181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-cdabf23c-6f10-464b-8ee6-5e46fac9aa2f req-58aa44c9-3d29-4f54-bc63-2ef4d89f90f6 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:55.881012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-cdabf23c-6f10-464b-8ee6-5e46fac9aa2f req-58aa44c9-3d29-4f54-bc63-2ef4d89f90f6 service nova] Creating event network-changed:15f04419-1f78-43d7-bb50-81c91f98250f for instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c on hv-cinder-84614 Jun 20 11:24:55.887023 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-cdabf23c-6f10-464b-8ee6-5e46fac9aa2f req-58aa44c9-3d29-4f54-bc63-2ef4d89f90f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042147 Jun 20 11:24:55.887630 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 514/1035] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:24:56.641136 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:56.641693 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:56.648681 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:56.649233 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:56.650027 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:56.652646 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:56.802116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:56.809820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6ec3a2c9-e289-4bf5-84a9-64965203f0fd tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1367 microversion: 2.1 time: 0.172755 Jun 20 11:24:56.810506 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 522/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:56 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:57.828243 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:57.828930 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:57.836506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:57.836986 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:57.837955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:57.838651 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:57.981520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:57.989955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d2291c1c-301e-4ae3-abb3-cf3130d3665c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1367 microversion: 2.1 time: 0.166391 Jun 20 11:24:57.990569 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 515/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:57 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:24:59.008013 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:24:59.008689 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:24:59.015423 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:59.015868 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:59.017487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:24:59.017924 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:24:59.161897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:24:59.169662 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7eeffa88-069d-4e79-adfb-fb452a1f504d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1367 microversion: 2.1 time: 0.165587 Jun 20 11:24:59.170217 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 523/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:24:59 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:25:00.187358 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:25:00.187959 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:25:00.195106 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:00.195539 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:00.196334 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:00.196777 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:00.331759 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:25:00.339880 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-00031350-cd82-4185-b23c-5a6a1147352e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1367 microversion: 2.1 time: 0.156577 Jun 20 11:25:00.340471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 516/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:25:00 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:25:00.590232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-ba29d8b4-2632-436b-99f4-ad99a3ef3cf0 req-538c5b52-d95d-46ff-94db-381a838d76dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc77317-f551-45c4-a36f-cd8fa55aca9c", "name": "network-vif-plugged", "status": "completed", "tag": "15f04419-1f78-43d7-bb50-81c91f98250f"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:25:00.599458 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ba29d8b4-2632-436b-99f4-ad99a3ef3cf0 req-538c5b52-d95d-46ff-94db-381a838d76dd service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:00.599902 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ba29d8b4-2632-436b-99f4-ad99a3ef3cf0 req-538c5b52-d95d-46ff-94db-381a838d76dd service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:00.613575 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-ba29d8b4-2632-436b-99f4-ad99a3ef3cf0 req-538c5b52-d95d-46ff-94db-381a838d76dd service nova] Creating event network-vif-plugged:15f04419-1f78-43d7-bb50-81c91f98250f for instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c on hv-cinder-84614 Jun 20 11:25:00.619540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-ba29d8b4-2632-436b-99f4-ad99a3ef3cf0 req-538c5b52-d95d-46ff-94db-381a838d76dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 Jun 20 11:25:00.620161 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 524/1040] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:25:01.357299 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:25:01.357948 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:25:01.365665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:01.366164 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:01.366918 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:01.367343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:01.505777 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:25:01.514183 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-4a8b6851-fbba-4cdd-b002-378a7b5217ad tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1367 microversion: 2.1 time: 0.160741 Jun 20 11:25:01.514776 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 517/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:25:01 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:25:02.537561 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:25:02.538370 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:25:02.545049 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:02.545490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:02.546301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:02.546744 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:02.692121 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:25:02.700209 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5b580362-a9d7-43a4-b579-6edaff1333b7 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1556 microversion: 2.1 time: 0.167678 Jun 20 11:25:02.700790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 525/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:25:02 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:25:02.719565 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:25:02.720117 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:25:02.728586 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:02.729236 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:02.730276 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:02.730884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:02.819496 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eabfe384-f6bc-4db2-a399-3eacf3251300 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103896 Jun 20 11:25:02.820099 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 518/1043] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 20 11:25:02 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:25:03.837627 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-32959dc2-53f9-4247-9cec-99d2f9fee1c0 req-00a78781-ccfa-4ae6-80d0-99715fbf8910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc77317-f551-45c4-a36f-cd8fa55aca9c", "tag": "15f04419-1f78-43d7-bb50-81c91f98250f"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:25:03.841755 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:25:03.853260 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-32959dc2-53f9-4247-9cec-99d2f9fee1c0 req-00a78781-ccfa-4ae6-80d0-99715fbf8910 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:25:03.853738 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-32959dc2-53f9-4247-9cec-99d2f9fee1c0 req-00a78781-ccfa-4ae6-80d0-99715fbf8910 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:25:03.867803 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-32959dc2-53f9-4247-9cec-99d2f9fee1c0 req-00a78781-ccfa-4ae6-80d0-99715fbf8910 service nova] Creating event network-changed:15f04419-1f78-43d7-bb50-81c91f98250f for instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c on hv-cinder-84614 Jun 20 11:25:03.873832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-32959dc2-53f9-4247-9cec-99d2f9fee1c0 req-00a78781-ccfa-4ae6-80d0-99715fbf8910 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040302 Jun 20 11:25:03.874464 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 526/1044] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:26:08.457040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:26:08.457976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:26:08.459926 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:26:08.460765 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:26:08.521424 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:08.521912 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:08.528757 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:08.529197 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:08.529947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:08.530403 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:08.558181 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e421c46a-b6c7-4f3f-b805-cf8f0e42be8e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/ips" status: 200 len: 147 microversion: 2.1 time: 0.103422 Jun 20 11:26:08.558746 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 519/1045] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:26:08 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/ips => generated 147 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:26:09.906906 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:26:09.907704 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:26:09.912317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a72989cb-99d5-4fa7-a8cc-4e0f76dd1ca0"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:26:09.913474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:09.921625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:09.922071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:09.922867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:09.923305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:10.339517 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f9a3f708-c965-420a-9fd5-2ebf119bff6b tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "POST /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434079 Jun 20 11:26:10.340511 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 527/1046] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 20 11:26:09 2022] POST /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:26:16.916113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:16.916655 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:16.923915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:16.924715 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:16.925486 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:16.925924 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:17.073134 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lazy-loading 'services' on Instance uuid 2fc77317-f551-45c4-a36f-cd8fa55aca9c {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:26:17.160701 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-6ea22da5-abc1-4b6a-8bcb-5f0b4ff4702c tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments/a72989cb-99d5-4fa7-a8cc-4e0f76dd1ca0" status: 202 len: 0 microversion: 2.1 time: 0.248433 Jun 20 11:26:17.161221 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 520/1047] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 20 11:26:16 2022] DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments/a72989cb-99d5-4fa7-a8cc-4e0f76dd1ca0 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 11:26:17.172593 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:17.173668 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:17.180819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:17.181259 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:17.182076 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:17.182558 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:17.213887 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6bf7d79c-bdfb-4a9c-966c-56450dc2b6c9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Jun 20 11:26:17.214473 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 528/1048] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:26:17 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:26:18.227658 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:18.228716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:18.235524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:18.235972 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:18.236735 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:18.237167 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:18.269201 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9330333a-2c31-4a6c-b25e-80a38102f8da tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046403 Jun 20 11:26:18.269832 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 521/1049] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 20 11:26:18 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 11:26:18.337463 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:18.338026 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:18.344977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:18.345434 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:18.346233 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:18.346677 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:18.374940 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:26:18.462097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e16238f6-fd97-4cba-a85a-8fc304093934 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 204 len: 0 microversion: 2.1 time: 0.128255 Jun 20 11:26:18.462897 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 529/1050] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:26:18 2022] DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:26:18.473082 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:18.473738 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:18.480257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:18.480702 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:18.481457 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:18.481884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:18.624336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:26:18.632882 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-5d8335a0-5d6a-4c62-9732-6b4c0b2bce15 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1679 microversion: 2.1 time: 0.164410 Jun 20 11:26:18.633448 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 522/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:18 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:26:19.653393 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:19.654358 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:19.663277 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:19.663925 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:19.664948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:19.665474 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:19.805842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:26:19.817283 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5f4a2861-d191-41df-9551-f8d272cee7de tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1679 microversion: 2.1 time: 0.169546 Jun 20 11:26:19.818060 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 530/1052] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:19 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:26:20.837315 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:20.837964 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:20.846517 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:20.847224 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:20.848254 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:20.848753 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:21.037646 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3a76fedfe349cb919d36ee4d688749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a3abf875c447d7afbd02d79fad4287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:26:21.045652 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c643c724-57de-4f85-ac05-9079f78e9db3 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 200 len: 1679 microversion: 2.1 time: 0.213910 Jun 20 11:26:21.046317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 523/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:20 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:26:21.391578 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-c24197ec-b6e5-4a05-8113-15cdfd16b3d5 req-c8fbf913-083d-441a-adbb-a296724eb0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc77317-f551-45c4-a36f-cd8fa55aca9c", "name": "network-vif-deleted", "tag": "15f04419-1f78-43d7-bb50-81c91f98250f"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:26:21.401611 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c24197ec-b6e5-4a05-8113-15cdfd16b3d5 req-c8fbf913-083d-441a-adbb-a296724eb0fc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:21.402057 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c24197ec-b6e5-4a05-8113-15cdfd16b3d5 req-c8fbf913-083d-441a-adbb-a296724eb0fc service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:21.415289 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-c24197ec-b6e5-4a05-8113-15cdfd16b3d5 req-c8fbf913-083d-441a-adbb-a296724eb0fc service nova] Creating event network-vif-deleted:15f04419-1f78-43d7-bb50-81c91f98250f for instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c on hv-cinder-84614 Jun 20 11:26:21.421544 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-c24197ec-b6e5-4a05-8113-15cdfd16b3d5 req-c8fbf913-083d-441a-adbb-a296724eb0fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034282 Jun 20 11:26:21.422422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 531/1054] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:26:22.067863 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:22.068459 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:22.075668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:22.076257 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:22.077418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:22.077879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:22.093199 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c HTTP/1.1 Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:22.095160 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:22.096685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '2fc77317-f551-45c4-a36f-cd8fa55aca9c'} Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:22.097716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:22.099152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:22.100420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:22.100420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-59b34be1-2075-415d-aee2-6059174de13f tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 404 len: 111 microversion: 2.1 time: 0.033026 Jun 20 11:26:22.100420 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 524/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:22 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:22.106449 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-27fd5d79-2c6b-434a-8367-cafa7c9366bb tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '.version_select at 0x7f72155325e0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:22.125553 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-27fd5d79-2c6b-434a-8367-cafa7c9366bb tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645775000" status: 202 len: 0 microversion: 2.1 time: 0.023470 Jun 20 11:26:22.126500 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 532/1056] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 20 11:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645775000 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 11:26:23.927805 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:23.928380 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:23.935395 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:23.935825 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:23.936662 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:23.937415 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:23.951057 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c HTTP/1.1 Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:23.952862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.954641 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '2fc77317-f551-45c4-a36f-cd8fa55aca9c'} Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:23.955473 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.956766 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.958113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:23.958113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-765d7e5d-a17c-4f1d-84a2-1e827fa9847a tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 404 len: 111 microversion: 2.1 time: 0.030965 Jun 20 11:26:23.958113 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 525/1057] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:26:23 2022] DELETE /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:23.967522 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:23.968552 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 2fc77317-f551-45c4-a36f-cd8fa55aca9c] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:23.977194 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:23.977646 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:23.978434 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:23.978862 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:23.992597 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c HTTP/1.1 Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:23.994266 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.995913 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '2fc77317-f551-45c4-a36f-cd8fa55aca9c'} Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:23.996790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. Jun 20 11:26:23.998467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:23.999901 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 2fc77317-f551-45c4-a36f-cd8fa55aca9c could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:23.999901 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-88c113fd-5b7f-41e5-ba4f-6a69de2b419d tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c" status: 404 len: 111 microversion: 2.1 time: 0.036279 Jun 20 11:26:23.999901 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 533/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:23 2022] GET /compute/v2.1/servers/2fc77317-f551-45c4-a36f-cd8fa55aca9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 11:26:25.139649 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:25.140188 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:25.147575 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.148018 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.148793 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.149242 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.163524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd HTTP/1.1 Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:25.165062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.166674 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd'} Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:25.167443 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.168670 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.169971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:25.169971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-55a4522e-9d0a-4554-a051-563aeb528ce1 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 404 len: 111 microversion: 2.1 time: 0.030744 Jun 20 11:26:25.169971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 526/1059] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:26:25 2022] DELETE /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:25.175467 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:25.176084 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:25.183038 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.183480 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.184232 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.184657 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.198654 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd HTTP/1.1 Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:25.200168 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.201850 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd'} Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:25.202819 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. Jun 20 11:26:25.204456 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.205768 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:25.205768 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-317480b5-7063-4eb1-9678-fe9012c075aa tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd" status: 404 len: 111 microversion: 2.1 time: 0.030274 Jun 20 11:26:25.205768 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 534/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:25 2022] GET /compute/v2.1/servers/5e89d468-2ea2-4dbb-b765-ddbf8d6cebfd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:25.211506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:25.212003 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:25.218426 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.218867 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.219619 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.220047 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.237727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e HTTP/1.1 Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:25.239859 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.241591 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': 'f9f8df54-735e-403e-9a9f-8cceaa167d4e'} Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:25.242526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.243761 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.245090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:25.245090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7b6ad101-65f3-4176-8374-c4b660f108a9 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 404 len: 111 microversion: 2.1 time: 0.034330 Jun 20 11:26:25.245090 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 527/1061] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:26:25 2022] DELETE /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:25.253003 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:25.253862 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: f9f8df54-735e-403e-9a9f-8cceaa167d4e] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:25.260856 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.261301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.262057 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:25.262531 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:25.277827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e HTTP/1.1 Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:25.279453 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.281215 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'f9f8df54-735e-403e-9a9f-8cceaa167d4e'} Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:25.282053 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. Jun 20 11:26:25.283591 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:25.284889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance f9f8df54-735e-403e-9a9f-8cceaa167d4e could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:25.284889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3ac4b8d7-a2db-4803-80d6-deaab356877e tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e" status: 404 len: 111 microversion: 2.1 time: 0.034135 Jun 20 11:26:25.284889 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 535/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:25 2022] GET /compute/v2.1/servers/f9f8df54-735e-403e-9a9f-8cceaa167d4e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:26.439265 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:26.439824 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:26.446935 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:26.447386 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:26.448150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:26.448581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:26.462516 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f HTTP/1.1 Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:26.464043 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.465807 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '5b7e6fbc-2ee7-4634-b66d-2739811d133f'} Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:26.466913 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.468484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.470158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:26.470158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-53695cab-21ab-4594-8444-ed0f84b8d845 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 404 len: 111 microversion: 2.1 time: 0.030130 Jun 20 11:26:26.470158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 528/1063] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:26:26 2022] DELETE /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:26.476378 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:26.477080 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] [instance: 5b7e6fbc-2ee7-4634-b66d-2739811d133f] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:26:26.487034 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:26.487619 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:26.488793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:26:26.489731 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:26:26.503491 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] HTTP exception thrown: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Request method failure captured: Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f HTTP/1.1 Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFfzdIdyfdKUAzZCz4irlTevlDTNq3AM0Fb87Saa8-FhiNiLWxNxV42C-VH20pnGFCWqGR_l-qxCJKPyEm8jpRnR9IU7EWGBpKYdvuAyyTq0Ab_hwu2GkyV_5bsTzEeJ3r-wL8SmuH0vDBtKNyW5OrBEqR0lMN9B7byNC39IGPETMZQ Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:26.505530 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90a3abf875c447d7afbd02d79fad4287"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90a3abf875c447d7afbd02d79fad4287 Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-420643602 Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: fb3a76fedfe349cb919d36ee4d688749 Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-420643602-project Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.507333 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '5b7e6fbc-2ee7-4634-b66d-2739811d133f'} Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:26.508312 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. Jun 20 11:26:26.509998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:26.511700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] Returning 404 to user: Instance 5b7e6fbc-2ee7-4634-b66d-2739811d133f could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:26.511700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-55531e57-861f-4561-b481-dd512f6de629 tempest-AttachVolumeNegativeTest-420643602 tempest-AttachVolumeNegativeTest-420643602-project] 10.222.0.33 "GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f" status: 404 len: 111 microversion: 2.1 time: 0.036875 Jun 20 11:26:26.511700 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 536/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:26:26 2022] GET /compute/v2.1/servers/5b7e6fbc-2ee7-4634-b66d-2739811d133f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:26:30.838828 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9af2394-63c2-485a-a6cd-2e6d82647abc tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Action: 'create', calling method: .version_select at 0x7f72158e04c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-89660438", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9af2394-63c2-485a-a6cd-2e6d82647abc tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Request method failure captured: Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 120 Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFlmfIvk8eXV1R2GcFSbSMQ40aR25BtvT0Quc-8gzJfnFEilP1HDPsTou2UVZMJq13xAC7As4mwAdeahnXxOvJVPlxGp27OUPa4fICkQtn2C8ZY9Bit2hWi3dY05h4bY4uCRZXZW9tlCcht-dLUPmcZEIFB1n7GCW30qsnpWcAYnF6g Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:30.858608 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28903e6e969a429b98b707f6db55c27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 497cac9e38c241efa5199042a38d212b Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-89660438", "metadata": {"Type": "work"}}} Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: Jun 20 11:26:30.860684 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-89660438', 'metadata': {'Type': 'work'}}}} Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:30.861653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:26:30.863295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:26:30.864633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 11:26:30.864633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.864633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a9af2394-63c2-485a-a6cd-2e6d82647abc tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:30.864633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a9af2394-63c2-485a-a6cd-2e6d82647abc tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165107 Jun 20 11:26:30.864633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 529/1065] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 20 11:26:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:26:30.872225 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-86990b33-1b50-4a39-9def-b994ae8690e0 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Action: 'create', calling method: .version_select at 0x7f72150440d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1841687764", "metadata": {"Type": "work"}}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-86990b33-1b50-4a39-9def-b994ae8690e0 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Request method failure captured: Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 120 Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFlmfIvk8eXV1R2GcFSbSMQ40aR25BtvT0Quc-8gzJfnFEilP1HDPsTou2UVZMJq13xAC7As4mwAdeahnXxOvJVPlxGp27OUPa4fICkQtn2C8ZY9Bit2hWi3dY05h4bY4uCRZXZW9tlCcht-dLUPmcZEIFB1n7GCW30qsnpWcAYnF6g Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:30.876150 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28903e6e969a429b98b707f6db55c27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 497cac9e38c241efa5199042a38d212b Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1841687764", "metadata": {"Type": "work"}}} Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:26:30.877809 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1841687764', 'metadata': {'Type': 'work'}}}} Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi '0' Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:30.878917 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:26:30.880585 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:26:30.882498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 11:26:30.882498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.882498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-86990b33-1b50-4a39-9def-b994ae8690e0 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:30.882498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-86990b33-1b50-4a39-9def-b994ae8690e0 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011185 Jun 20 11:26:30.882498 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 537/1066] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 20 11:26:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:26:30.887425 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c9fe186-8569-487b-af1a-57ca521fdb8f tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Action: 'create', calling method: .version_select at 0x7f72159a7430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802955607", "metadata": {"Type": "work"}}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c9fe186-8569-487b-af1a-57ca521fdb8f tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Request method failure captured: Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 119 Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFlmfIvk8eXV1R2GcFSbSMQ40aR25BtvT0Quc-8gzJfnFEilP1HDPsTou2UVZMJq13xAC7As4mwAdeahnXxOvJVPlxGp27OUPa4fICkQtn2C8ZY9Bit2hWi3dY05h4bY4uCRZXZW9tlCcht-dLUPmcZEIFB1n7GCW30qsnpWcAYnF6g Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:30.889799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28903e6e969a429b98b707f6db55c27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 497cac9e38c241efa5199042a38d212b Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802955607", "metadata": {"Type": "work"}}} Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: Jun 20 11:26:30.891447 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802955607', 'metadata': {'Type': 'work'}}}} Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise error Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi '' Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:30.892460 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 11:26:30.894230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 11:26:30.895719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 11:26:30.895719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.895719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-7c9fe186-8569-487b-af1a-57ca521fdb8f tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:30.895719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-7c9fe186-8569-487b-af1a-57ca521fdb8f tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007786 Jun 20 11:26:30.895719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 530/1067] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 20 11:26:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 11:26:30.900633 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9552cbb-fd59-4393-8b16-dfca12bde4cb tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Calling method '.version_select at 0x7f72155620d0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:30.930927 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-f9552cbb-fd59-4393-8b16-dfca12bde4cb tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] HTTP exception thrown: Volume tempest-invalid-1888452348 could not be found. Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9552cbb-fd59-4393-8b16-dfca12bde4cb tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Request method failure captured: Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1888452348 HTTP/1.1 Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFlmfIvk8eXV1R2GcFSbSMQ40aR25BtvT0Quc-8gzJfnFEilP1HDPsTou2UVZMJq13xAC7As4mwAdeahnXxOvJVPlxGp27OUPa4fICkQtn2C8ZY9Bit2hWi3dY05h4bY4uCRZXZW9tlCcht-dLUPmcZEIFB1n7GCW30qsnpWcAYnF6g Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:30.932915 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28903e6e969a429b98b707f6db55c27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 497cac9e38c241efa5199042a38d212b Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Volume tempest-invalid-1888452348 could not be found. Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'tempest-invalid-1888452348'} Jun 20 11:26:30.934565 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1888452348 could not be found. (HTTP 404) (Request-ID: req-e8e8fa8a-b54f-440e-8897-d47bfdbd9951) Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.935533 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 11:26:30.937131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1888452348 could not be found. Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:30.938840 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1888452348 could not be found. Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1888452348 could not be found. Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9552cbb-fd59-4393-8b16-dfca12bde4cb tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Returning 404 to user: Volume tempest-invalid-1888452348 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f9552cbb-fd59-4393-8b16-dfca12bde4cb tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1888452348" status: 404 len: 99 microversion: 2.1 time: 0.037745 Jun 20 11:26:30.946939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 538/1068] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 20 11:26:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1888452348 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 11:26:30.948001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-66b82215-b3fc-4b04-b0af-d77608ae2317 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005353 Jun 20 11:26:30.948001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 531/1069] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jun 20 11:26:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 11:26:30.955124 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dc019c4b-12be-4a80-9abd-f7afc4f113f9 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003806 Jun 20 11:26:30.955583 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 539/1070] 10.222.0.33 () {58 vars in 1136 bytes} [Mon Jun 20 11:26:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 11:26:30.964320 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c8239c9-702a-4a2e-bc9e-5706f730e334 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Calling method '.version_select at 0x7f721590f8b0>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:30.993228 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-8c8239c9-702a-4a2e-bc9e-5706f730e334 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] HTTP exception thrown: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c8239c9-702a-4a2e-bc9e-5706f730e334 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Request method failure captured: Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: DELETE /compute/v2.1/os-volumes/0508fc4c-d067-48ca-b8b9-61f824ae3a7e HTTP/1.1 Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFlmfIvk8eXV1R2GcFSbSMQ40aR25BtvT0Quc-8gzJfnFEilP1HDPsTou2UVZMJq13xAC7As4mwAdeahnXxOvJVPlxGp27OUPa4fICkQtn2C8ZY9Bit2hWi3dY05h4bY4uCRZXZW9tlCcht-dLUPmcZEIFB1n7GCW30qsnpWcAYnF6g Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:26:30.995192 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28903e6e969a429b98b707f6db55c27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 497cac9e38c241efa5199042a38d212b Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '0508fc4c-d067-48ca-b8b9-61f824ae3a7e'} Jun 20 11:26:30.996946 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. (HTTP 404) (Request-ID: req-46c0fa56-7796-495b-8d90-159b904ea7f0) Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:30.997858 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 11:26:30.999175 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 11:26:31.000465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8c8239c9-702a-4a2e-bc9e-5706f730e334 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Returning 404 to user: Volume 0508fc4c-d067-48ca-b8b9-61f824ae3a7e could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8c8239c9-702a-4a2e-bc9e-5706f730e334 tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/0508fc4c-d067-48ca-b8b9-61f824ae3a7e" status: 404 len: 109 microversion: 2.1 time: 0.035955 Jun 20 11:26:31.001814 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 532/1071] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 20 11:26:30 2022] DELETE /compute/v2.1/os-volumes/0508fc4c-d067-48ca-b8b9-61f824ae3a7e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 11:26:31.011492 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5f249176-74fe-49b6-8625-c6e4a828844e tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Calling method '.version_select at 0x7f72153b7dc0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:26:31.042729 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-5f249176-74fe-49b6-8625-c6e4a828844e tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] HTTP exception thrown: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5f249176-74fe-49b6-8625-c6e4a828844e tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Request method failure captured: Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-volumes/1fc760bf-4a6e-49f1-bfc6-b6094a52410f HTTP/1.1 Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFlmfIvk8eXV1R2GcFSbSMQ40aR25BtvT0Quc-8gzJfnFEilP1HDPsTou2UVZMJq13xAC7As4mwAdeahnXxOvJVPlxGp27OUPa4fICkQtn2C8ZY9Bit2hWi3dY05h4bY4uCRZXZW9tlCcht-dLUPmcZEIFB1n7GCW30qsnpWcAYnF6g Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:26:31.044655 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28903e6e969a429b98b707f6db55c27c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28903e6e969a429b98b707f6db55c27c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 28903e6e969a429b98b707f6db55c27c Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesNegativeTest-673144755 Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: 497cac9e38c241efa5199042a38d212b Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesNegativeTest-673144755-project Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '1fc760bf-4a6e-49f1-bfc6-b6094a52410f'} Jun 20 11:26:31.046376 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. (HTTP 404) (Request-ID: req-e07f42be-c67f-4c4e-acbd-4dc998e63456) Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:31.047433 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 11:26:31.048857 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 11:26:31.050524 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5f249176-74fe-49b6-8625-c6e4a828844e tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] Returning 404 to user: Volume 1fc760bf-4a6e-49f1-bfc6-b6094a52410f could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5f249176-74fe-49b6-8625-c6e4a828844e tempest-VolumesNegativeTest-673144755 tempest-VolumesNegativeTest-673144755-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1fc760bf-4a6e-49f1-bfc6-b6094a52410f" status: 404 len: 109 microversion: 2.1 time: 0.042278 Jun 20 11:26:31.052074 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 540/1072] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 20 11:26:31 2022] GET /compute/v2.1/os-volumes/1fc760bf-4a6e-49f1-bfc6-b6094a52410f => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:27:12.526931 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=20 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:12.527685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:12.531763 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1267728241", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "networks": [{"uuid": "36d04513-48d7-4ba3-a596-9a5d512c01fc"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:12.585976 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] validate_networks() for [('36d04513-48d7-4ba3-a596-9a5d512c01fc', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:27:12.997965 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:27:12.998421 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:27:12.998961 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:27:12.999297 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:27:12.999704 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:27:13.014458 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:13.015174 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:13.016454 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:13.017121 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:13.037372 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Getting quotas for project d87dd26331ac46338a1d19800fd1c067. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:27:13.041685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Getting quotas for user bf758ca5ff364fa6b56e841128a1b4fb and project d87dd26331ac46338a1d19800fd1c067. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:27:13.054629 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:27:13.057008 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:27:13.122947 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ede10a25-b5a5-4e8a-a814-d6508e9dfdf2 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597552 Jun 20 11:27:13.123602 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 533/1073] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:27:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 11:27:13.131590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:13.133065 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:13.137060 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-65ea3f0a-4e9d-48d5-bd46-4e6afda10aa1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:13.137701 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-65ea3f0a-4e9d-48d5-bd46-4e6afda10aa1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:13.198162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-65ea3f0a-4e9d-48d5-bd46-4e6afda10aa1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:13.206603 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-65ea3f0a-4e9d-48d5-bd46-4e6afda10aa1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1214 microversion: 2.1 time: 0.076535 Jun 20 11:27:13.207111 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 541/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:13 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:14.223574 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:14.224387 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:14.231988 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:14.232848 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:14.233813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:14.234445 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:14.344012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:14.352111 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-cfce7a6f-0b21-4096-81a0-c95ab5a4c944 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1284 microversion: 2.1 time: 0.132800 Jun 20 11:27:14.352669 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 534/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:14 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:15.369719 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:15.370337 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:15.378169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:15.378733 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:15.379737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:15.380237 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:15.520400 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:15.528413 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ef19b5a0-2bfc-45a6-9897-03bb97c983dd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.163293 Jun 20 11:27:15.528998 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 542/1076] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:15 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:15.733418 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-34dbfa06-fd48-4ce5-9841-fb530ad52a86 req-0849d6c6-a3e5-4162-ae54-0fb45391a824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "813b77f6-f9d0-4f94-8ae5-e22949aa3c90", "tag": "520ce4fb-ae75-44ad-b0aa-32aa6a7d848b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:15.742769 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-34dbfa06-fd48-4ce5-9841-fb530ad52a86 req-0849d6c6-a3e5-4162-ae54-0fb45391a824 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:15.743220 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-34dbfa06-fd48-4ce5-9841-fb530ad52a86 req-0849d6c6-a3e5-4162-ae54-0fb45391a824 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:15.757202 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-34dbfa06-fd48-4ce5-9841-fb530ad52a86 req-0849d6c6-a3e5-4162-ae54-0fb45391a824 service nova] Creating event network-changed:520ce4fb-ae75-44ad-b0aa-32aa6a7d848b for instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 on hv-cinder-84614 Jun 20 11:27:15.763413 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-34dbfa06-fd48-4ce5-9841-fb530ad52a86 req-0849d6c6-a3e5-4162-ae54-0fb45391a824 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164364 Jun 20 11:27:15.764020 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 535/1077] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:27:16.545798 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:16.546513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:16.554404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:16.554931 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:16.555824 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:16.556317 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:16.698116 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:16.709043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d84af646-7dc5-4f3b-b516-1625ac7075ff tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.167518 Jun 20 11:27:16.709818 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 543/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:16 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:17.729297 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:17.730052 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:17.736866 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:17.737328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:17.738059 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:17.738511 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:17.967452 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:17.975322 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-96eb3ab0-c8eb-4ff1-bd5c-2ef1bda38f21 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.251106 Jun 20 11:27:17.975945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 536/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:17 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:18.993081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:18.993710 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:19.002253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:19.003162 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:19.004471 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:19.005186 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:19.157894 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:19.165659 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-51bbd904-65d4-4ad1-8286-75ea9231d60b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.176473 Jun 20 11:27:19.166404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 544/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:18 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:20.185137 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:20.185709 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:20.192666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:20.193114 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:20.193884 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:20.194360 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:20.329244 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:20.337557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-9a61a709-9646-424a-8614-e1d5cf43c6c8 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.156307 Jun 20 11:27:20.337966 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 537/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:20 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:21.243214 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-36c11e53-de0a-43ef-b242-9f8d6fa65693 req-b77a068e-1cda-4801-be9f-0fd2e1390711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813b77f6-f9d0-4f94-8ae5-e22949aa3c90", "name": "network-vif-plugged", "status": "completed", "tag": "520ce4fb-ae75-44ad-b0aa-32aa6a7d848b"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:21.252984 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-36c11e53-de0a-43ef-b242-9f8d6fa65693 req-b77a068e-1cda-4801-be9f-0fd2e1390711 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:21.253439 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-36c11e53-de0a-43ef-b242-9f8d6fa65693 req-b77a068e-1cda-4801-be9f-0fd2e1390711 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:21.265468 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-36c11e53-de0a-43ef-b242-9f8d6fa65693 req-b77a068e-1cda-4801-be9f-0fd2e1390711 service nova] Creating event network-vif-plugged:520ce4fb-ae75-44ad-b0aa-32aa6a7d848b for instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 on hv-cinder-84614 Jun 20 11:27:21.270827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-36c11e53-de0a-43ef-b242-9f8d6fa65693 req-b77a068e-1cda-4801-be9f-0fd2e1390711 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097520 Jun 20 11:27:21.271390 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 545/1082] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:27:21.356595 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:21.357750 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:21.367062 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:21.367672 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:21.368581 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:21.369423 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:21.559992 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:21.567633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-eb970a7c-85ef-44a9-9165-183e89db118b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.216590 Jun 20 11:27:21.568234 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 538/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:21 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:22.586050 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:22.586751 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:22.594193 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:22.594643 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:22.595404 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:22.595832 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:22.729537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:22.737469 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-574f5439-b244-4b1c-a3f6-a4fff24a0d2b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1314 microversion: 2.1 time: 0.156229 Jun 20 11:27:22.738046 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 546/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:22 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:23.755011 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:23.755632 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:23.757974 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:23.758666 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:23.765465 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:23.765916 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:23.766719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:23.767152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:23.904426 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:23.912466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-51d192a4-1811-4175-9ea1-29534d3bc292 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1496 microversion: 2.1 time: 0.161493 Jun 20 11:27:23.913050 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 539/1085] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:23 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:24.305221 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:24.305845 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:24.308075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:24.314112 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:24.314590 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:24.315360 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:24.315790 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:24.341107 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:27:24.418951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-78df8cd0-ec76-40ee-82a5-601818c7c8b6 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "DELETE /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 204 len: 0 microversion: 2.1 time: 0.117328 Jun 20 11:27:24.419758 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 547/1086] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:27:24 2022] DELETE /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:27:24.428685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:24.429295 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:24.435716 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:24.436152 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:24.436904 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:24.437328 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:24.570218 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:24.578302 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-b41847ec-b284-425b-9480-6179d4a3a2cd tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1502 microversion: 2.1 time: 0.153579 Jun 20 11:27:24.578850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 540/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:24 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:25.597043 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:25.597752 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:25.604748 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:25.605205 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:25.605965 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:25.606478 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:25.744203 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:25.751989 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-33e10e29-4810-4809-80ab-1f3b68102389 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 200 len: 1502 microversion: 2.1 time: 0.159291 Jun 20 11:27:25.752576 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 548/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:25 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:26.296603 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-67769433-20d2-4108-af2a-ba4dc8f40729 req-315908cf-3a23-4efa-897e-fb6d7a95af07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "813b77f6-f9d0-4f94-8ae5-e22949aa3c90", "name": "network-vif-deleted", "tag": "520ce4fb-ae75-44ad-b0aa-32aa6a7d848b"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:26.306348 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-67769433-20d2-4108-af2a-ba4dc8f40729 req-315908cf-3a23-4efa-897e-fb6d7a95af07 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:26.306818 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-67769433-20d2-4108-af2a-ba4dc8f40729 req-315908cf-3a23-4efa-897e-fb6d7a95af07 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:26.326577 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-67769433-20d2-4108-af2a-ba4dc8f40729 req-315908cf-3a23-4efa-897e-fb6d7a95af07 service nova] Creating event network-vif-deleted:520ce4fb-ae75-44ad-b0aa-32aa6a7d848b for instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 on hv-cinder-84614 Jun 20 11:27:26.332908 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-67769433-20d2-4108-af2a-ba4dc8f40729 req-315908cf-3a23-4efa-897e-fb6d7a95af07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039987 Jun 20 11:27:26.333537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 541/1089] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:27:26.769192 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:26.769807 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: 813b77f6-f9d0-4f94-8ae5-e22949aa3c90] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:26.777154 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:26.777592 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:26.778392 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:26.778829 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:26.792750 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] HTTP exception thrown: Instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 could not be found. Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Request method failure captured: Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 HTTP/1.1 Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFmO2GFRy88TP482Vo06n06X5879krdb5KerO6Rj7-f2eeGVYzuP4PZB-kCXpv5v1-HCga-Ce6bgvOBdYByraGWyLdpO_gQ3uvCfhqkrK3P0rxepQY6jZ3uqzMf_RWFJHaRs2l8h4pzgyogusYlG0mvzXho5vAmQIab9Vw_-DP4naMo Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: d87dd26331ac46338a1d19800fd1c067 Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesActionsTest-1134061344 Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:27:26.794692 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesActionsTest-1134061344 Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: d87dd26331ac46338a1d19800fd1c067 Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesActionsTest-1134061344 Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesActionsTest-1134061344-project Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: bf758ca5ff364fa6b56e841128a1b4fb Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesActionsTest-1134061344-project Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 could not be found. Jun 20 11:27:26.797494 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': '813b77f6-f9d0-4f94-8ae5-e22949aa3c90'} Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 could not be found. Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:27:26.799450 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 could not be found. Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 could not be found. Jun 20 11:27:26.802318 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:26.804460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Returning 404 to user: Instance 813b77f6-f9d0-4f94-8ae5-e22949aa3c90 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:27:26.804460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bab3e8ca-eba8-4d89-bd20-ba5c615e84fc tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90" status: 404 len: 111 microversion: 2.1 time: 0.031015 Jun 20 11:27:26.804460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 549/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:26 2022] GET /compute/v2.1/servers/813b77f6-f9d0-4f94-8ae5-e22949aa3c90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:27:26.848626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1628559348", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452", "networks": [{"uuid": "36d04513-48d7-4ba3-a596-9a5d512c01fc"}]}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:26.906336 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] validate_networks() for [('36d04513-48d7-4ba3-a596-9a5d512c01fc', None, None, None, None, None)] {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:27:27.284520 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:27:27.284971 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:27:27.285434 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:27:27.286128 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:27:27.286519 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:27:27.296857 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:27.297528 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:27.298492 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:27.298929 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:27.316854 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Getting quotas for project d87dd26331ac46338a1d19800fd1c067. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:27:27.321004 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Getting quotas for user bf758ca5ff364fa6b56e841128a1b4fb and project d87dd26331ac46338a1d19800fd1c067. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:27:27.332981 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:27:27.335354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:27:27.379905 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-1dc1883c-3c46-487e-95bd-b5833b9fb823 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536147 Jun 20 11:27:27.380525 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 542/1091] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:27:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:27:27.391918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-604cafe1-389d-41ce-a47a-dd8e399c436f tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:27.392517 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-604cafe1-389d-41ce-a47a-dd8e399c436f tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:27.453062 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-604cafe1-389d-41ce-a47a-dd8e399c436f tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:27.461490 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-604cafe1-389d-41ce-a47a-dd8e399c436f tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1214 microversion: 2.1 time: 0.073771 Jun 20 11:27:27.462147 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 550/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:27 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:28.480523 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:28.481544 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:28.489333 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:28.489780 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:28.490675 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:28.491103 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:28.575653 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:28.584945 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-91c7cbec-2b31-4ec0-9e2f-4afa68c0c324 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1272 microversion: 2.1 time: 0.109993 Jun 20 11:27:28.585749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 543/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:28 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:29.603892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:29.605172 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:29.613973 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:29.614460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:29.615250 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:29.615686 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:29.766981 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:29.776326 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3673af21-22f0-4adf-841c-a6fbd513801b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.177064 Jun 20 11:27:29.776937 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 551/1094] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:29 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:29.900341 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-cb086e18-f163-4416-b0a9-b07e2acd4bca req-4eb460f1-112a-4c75-9b06-1e87263e6737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9aa653-369f-4b05-ba29-5e4b0e55c3d6", "tag": "f7025ca2-a438-4251-9b8d-305833fdfa5c"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:29.909909 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-cb086e18-f163-4416-b0a9-b07e2acd4bca req-4eb460f1-112a-4c75-9b06-1e87263e6737 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:29.910044 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-cb086e18-f163-4416-b0a9-b07e2acd4bca req-4eb460f1-112a-4c75-9b06-1e87263e6737 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:29.923980 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-cb086e18-f163-4416-b0a9-b07e2acd4bca req-4eb460f1-112a-4c75-9b06-1e87263e6737 service nova] Creating event network-changed:f7025ca2-a438-4251-9b8d-305833fdfa5c for instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 on hv-cinder-84614 Jun 20 11:27:29.929101 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-cb086e18-f163-4416-b0a9-b07e2acd4bca req-4eb460f1-112a-4c75-9b06-1e87263e6737 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Jun 20 11:27:29.929723 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 544/1095] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:27:30.793489 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:30.794199 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:30.801567 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:30.802016 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:30.802827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:30.803262 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:30.940097 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:30.948548 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7f1155a2-29a6-4272-981a-e9aa75edefc7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.159194 Jun 20 11:27:30.949126 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 552/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:30 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:31.966377 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:31.967040 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:31.974141 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:31.974621 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:31.975395 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:31.975833 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:32.166343 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:32.174914 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-a1235fd5-6ed4-42fd-9bd5-c30eabddc5da tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.213335 Jun 20 11:27:32.175682 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 545/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:31 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:33.192679 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:33.193255 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:33.200799 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:33.201239 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:33.202108 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:33.202645 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:33.589784 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:33.599942 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ee525e51-f4d4-4a74-ace8-c5de56daa314 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.411700 Jun 20 11:27:33.600508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 553/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:33 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:34.619471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:34.620069 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:34.626839 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:34.627285 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:34.628068 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:34.628500 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:34.773740 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:34.782870 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-93075ec8-c08e-47b5-823d-66fe33dc93ea tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.168022 Jun 20 11:27:34.783468 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 546/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:34 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:35.801440 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:35.802140 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:35.808813 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:35.809285 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:35.810197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:35.810661 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:35.957773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:35.966100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0ad666cd-f1dc-4c05-a632-0d619719f59d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.168978 Jun 20 11:27:35.966795 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 554/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:35 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:36.984034 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:36.984633 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:36.991902 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:36.992354 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:36.993154 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:36.993579 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:37.139850 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:37.149226 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-d6b2680a-fa40-49db-8dd0-55b0277a5b06 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.168826 Jun 20 11:27:37.149834 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 547/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:36 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:37.269076 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a9ea7b68-b573-4b25-83df-75b6e938ea34 req-047540fc-3578-485a-a4d2-1146fe24d56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9aa653-369f-4b05-ba29-5e4b0e55c3d6", "name": "network-vif-plugged", "status": "completed", "tag": "f7025ca2-a438-4251-9b8d-305833fdfa5c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:37.278311 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a9ea7b68-b573-4b25-83df-75b6e938ea34 req-047540fc-3578-485a-a4d2-1146fe24d56b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:37.278640 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a9ea7b68-b573-4b25-83df-75b6e938ea34 req-047540fc-3578-485a-a4d2-1146fe24d56b service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:37.291773 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a9ea7b68-b573-4b25-83df-75b6e938ea34 req-047540fc-3578-485a-a4d2-1146fe24d56b service nova] Creating event network-vif-plugged:f7025ca2-a438-4251-9b8d-305833fdfa5c for instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 on hv-cinder-84614 Jun 20 11:27:37.296888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a9ea7b68-b573-4b25-83df-75b6e938ea34 req-047540fc-3578-485a-a4d2-1146fe24d56b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 Jun 20 11:27:37.297489 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 555/1102] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:27:38.167665 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:38.168255 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:38.170290 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:38.171244 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:38.178479 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:38.178904 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:38.179658 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:38.180082 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:38.318637 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:38.326636 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-8a7046e9-da71-45dd-9d25-4b22427aacce tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1314 microversion: 2.1 time: 0.163064 Jun 20 11:27:38.327210 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 548/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:38 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:39.341834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:39.349236 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:39.350319 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:39.359106 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:39.359727 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:39.360487 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:39.361025 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:39.533939 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:39.542919 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-08af8032-ffa3-4ca2-8d62-ba280ce35626 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1496 microversion: 2.1 time: 0.203004 Jun 20 11:27:39.543496 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 556/1104] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:39 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1496 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:40.008005 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:40.008593 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:40.015456 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:40.015903 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:40.016663 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:40.017095 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:40.042317 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Going to try to terminate instance {{(pid=117606) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:27:40.134628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-797cac81-5bac-4cb2-8c7e-a50a9cce4969 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 204 len: 0 microversion: 2.1 time: 0.130225 Jun 20 11:27:40.135407 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 549/1105] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:27:40 2022] DELETE /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:27:40.144197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:40.144817 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:40.151298 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:40.151770 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:40.152540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:40.152977 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:40.296540 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:40.304584 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-50f0c675-fe98-48cd-a6fc-f0114f2c46c1 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1502 microversion: 2.1 time: 0.164351 Jun 20 11:27:40.305143 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 557/1106] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:40 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:40.562007 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:27:40.562308 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:27:41.327724 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:41.330120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:41.339685 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:41.340118 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:41.340896 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:41.341375 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:41.506471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:41.515147 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-e12638b3-14fe-4a3a-a0f8-0a6ba7c14f8d tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1502 microversion: 2.1 time: 0.194619 Jun 20 11:27:41.515745 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 550/1107] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:41 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:42.032167 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-21255bb9-d0d0-4aeb-921b-5724baac81b9 req-92b2cad9-e1d6-43f0-8f02-06b36dde9e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9aa653-369f-4b05-ba29-5e4b0e55c3d6", "name": "network-vif-deleted", "tag": "f7025ca2-a438-4251-9b8d-305833fdfa5c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:27:42.041278 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-21255bb9-d0d0-4aeb-921b-5724baac81b9 req-92b2cad9-e1d6-43f0-8f02-06b36dde9e49 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:42.041713 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-21255bb9-d0d0-4aeb-921b-5724baac81b9 req-92b2cad9-e1d6-43f0-8f02-06b36dde9e49 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:42.054021 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-21255bb9-d0d0-4aeb-921b-5724baac81b9 req-92b2cad9-e1d6-43f0-8f02-06b36dde9e49 service nova] Creating event network-vif-deleted:f7025ca2-a438-4251-9b8d-305833fdfa5c for instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 on hv-cinder-84614 Jun 20 11:27:42.060737 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-21255bb9-d0d0-4aeb-921b-5724baac81b9 req-92b2cad9-e1d6-43f0-8f02-06b36dde9e49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Jun 20 11:27:42.061486 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 558/1108] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:27:42.533829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:42.534466 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:42.541150 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:42.541594 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:42.542639 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:42.543032 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:42.547422 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:42.576230 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:42.582280 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:42.582726 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:42.583171 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.objects.instance [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lazy-loading 'fault' on Instance uuid dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 {{(pid=117606) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:27:42.629686 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf758ca5ff364fa6b56e841128a1b4fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd87dd26331ac46338a1d19800fd1c067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:27:42.637799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-c050b1d4-3fbd-4916-aa53-b9d9014a4af7 tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 200 len: 1304 microversion: 2.1 time: 0.108831 Jun 20 11:27:42.638545 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 551/1109] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:42 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:27:43.657820 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:27:43.658547 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] [instance: dd9aa653-369f-4b05-ba29-5e4b0e55c3d6] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:27:43.660513 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:43.666967 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:43.667422 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:43.668257 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:27:43.668695 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:27:43.671892 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:27:43.685270 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] HTTP exception thrown: Instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 could not be found. Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Request method failure captured: Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 HTTP/1.1 Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept: application/json Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Connection: close Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Length: 0 Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Content-Type: application/json Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABisFmO2GFRy88TP482Vo06n06X5879krdb5KerO6Rj7-f2eeGVYzuP4PZB-kCXpv5v1-HCga-Ce6bgvOBdYByraGWyLdpO_gQ3uvCfhqkrK3P0rxepQY6jZ3uqzMf_RWFJHaRs2l8h4pzgyogusYlG0mvzXho5vAmQIab9Vw_-DP4naMo Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Id: None Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Domain-Name: None Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Id: d87dd26331ac46338a1d19800fd1c067 Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesActionsTest-1134061344 Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Role: member,reader Jun 20 11:27:43.687100 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Roles: member,reader Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d87dd26331ac46338a1d19800fd1c067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesActionsTest-1134061344 Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Id: d87dd26331ac46338a1d19800fd1c067 Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesActionsTest-1134061344 Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesActionsTest-1134061344-project Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Id: bf758ca5ff364fa6b56e841128a1b4fb Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesActionsTest-1134061344-project Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: method: > Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: exception: Instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 could not be found. Jun 20 11:27:43.688720 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: action_args: {'id': 'dd9aa653-369f-4b05-ba29-5e4b0e55c3d6'} Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 could not be found. Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:27:43.689556 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 could not be found. Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 could not be found. Jun 20 11:27:43.690951 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Jun 20 11:27:43.692191 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] Returning 404 to user: Instance dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:27:43.692191 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f7c70ec3-425d-4ed1-af24-e033d1225a3b tempest-VolumesActionsTest-1134061344 tempest-VolumesActionsTest-1134061344-project] 10.222.0.33 "GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6" status: 404 len: 111 microversion: 2.1 time: 0.035571 Jun 20 11:27:43.692191 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 559/1110] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:27:43 2022] GET /compute/v2.1/servers/dd9aa653-369f-4b05-ba29-5e4b0e55c3d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:28:02.649071 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:28:02.649834 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:28:08.774998 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1449740986", "imageRef": "8f7caaa4-a592-4d62-b70a-3e8312dbc022", "flavorRef": "452"}} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:28:08.780881 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_api:SELECT=1 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:28:08.781484 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell1:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:28:08.852468 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.network.neutron [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] validate_networks() for None {{(pid=117606) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 11:28:09.140120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Flavor limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 11:28:09.140568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Image limits 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 11:28:09.141035 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Flavor pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 11:28:09.141435 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Image pref 0:0:0 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 11:28:09.141840 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.virt.hardware [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117606) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 11:28:09.151305 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:09.151749 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:09.152538 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:09.153370 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:09.171378 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Getting quotas for project 44bccb33574a441ca04a3da2d1ed1585. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 11:28:09.175967 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.quota [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Getting quotas for user 6d5b7c9509c8442d829c28380dbcb8a7 and project 44bccb33574a441ca04a3da2d1ed1585. Resources: {'instances', 'cores', 'ram'} {{(pid=117606) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 11:28:09.188016 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Going to run 1 instances... {{(pid=117606) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 11:28:09.190316 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8f7caaa4-a592-4d62-b70a-3e8312dbc022',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117606) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 11:28:09.238862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ada2a31b-3fb5-4367-84ca-df44edccd345 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.467923 Jun 20 11:28:09.239506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 552/1111] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 20 11:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 11:28:09.252600 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-612e3a97-adf1-48e2-86c6-4652567d1fac tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:09.253197 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-612e3a97-adf1-48e2-86c6-4652567d1fac tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:09.255570 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:28:09.316305 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-612e3a97-adf1-48e2-86c6-4652567d1fac tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:09.323418 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-612e3a97-adf1-48e2-86c6-4652567d1fac tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1215 microversion: 2.1 time: 0.074864 Jun 20 11:28:09.324006 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 560/1112] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:09 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 11:28:10.342817 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:10.344061 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:10.352298 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:10.352742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:10.353506 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:10.353932 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:10.604955 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:10.613607 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ebe2fad0-47ce-47e3-b12a-b4f4aebd23d2 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1273 microversion: 2.1 time: 0.275841 Jun 20 11:28:10.622471 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 553/1113] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:10 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:11.631871 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:11.632460 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:11.640424 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:11.640865 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:11.641644 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:11.642075 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:11.761879 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-8cbf1891-8afb-4401-a48a-dbd17d5c654e req-9d56e7de-c49a-4cca-a8f8-465de04318be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c6c1924-71ca-4790-a0f3-b65c6f74140d", "tag": "b5d61191-2b6c-4044-b457-d2bc922387e8"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:28:11.778917 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8cbf1891-8afb-4401-a48a-dbd17d5c654e req-9d56e7de-c49a-4cca-a8f8-465de04318be service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:11.779626 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-8cbf1891-8afb-4401-a48a-dbd17d5c654e req-9d56e7de-c49a-4cca-a8f8-465de04318be service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:11.794827 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:11.799017 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-8cbf1891-8afb-4401-a48a-dbd17d5c654e req-9d56e7de-c49a-4cca-a8f8-465de04318be service nova] Creating event network-changed:b5d61191-2b6c-4044-b457-d2bc922387e8 for instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d on hv-cinder-84614 Jun 20 11:28:11.804501 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-24ce23e9-91e4-4d32-bc73-3ed8bbac93e8 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.176362 Jun 20 11:28:11.804742 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-8cbf1891-8afb-4401-a48a-dbd17d5c654e req-9d56e7de-c49a-4cca-a8f8-465de04318be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046636 Jun 20 11:28:11.805749 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 561/1115] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:11 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:11.814767 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 554/1115] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 11:28:12.829056 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:12.830019 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:12.841083 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:12.841867 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:12.842681 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:12.843121 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:12.985616 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:12.993195 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6068fc19-19fa-4aa9-b428-e36917124d75 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.173204 Jun 20 11:28:12.993761 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 562/1116] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:12 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:14.016325 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:14.017106 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:14.024668 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:14.025280 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:14.026120 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:14.026713 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:14.248791 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:14.256813 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-ace5c9e5-bb46-4557-9c5c-6fa967df917b tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.248430 Jun 20 11:28:14.257382 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 555/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:14 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:15.274169 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:15.274759 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:15.281920 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:15.282407 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:15.283182 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:15.283625 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:15.418842 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:15.426961 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ba0414df-0d16-4ebd-9843-3a6b33b8aced tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.156819 Jun 20 11:28:15.427509 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 563/1118] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:15 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:16.444411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:16.445001 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:16.451958 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:16.452396 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:16.453155 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:16.453580 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:16.585568 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:16.594074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-392e89b2-bc1b-41cc-b140-91ea91a3c4fd tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.153641 Jun 20 11:28:16.594700 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 556/1119] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:16 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:17.499888 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-6039226b-fe77-4476-8a56-336b798cd323 req-8323c6c5-8df3-49a9-b32f-b59dd8a57ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6c1924-71ca-4790-a0f3-b65c6f74140d", "name": "network-vif-plugged", "status": "completed", "tag": "b5d61191-2b6c-4044-b457-d2bc922387e8"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:28:17.508588 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6039226b-fe77-4476-8a56-336b798cd323 req-8323c6c5-8df3-49a9-b32f-b59dd8a57ae8 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:17.509144 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6039226b-fe77-4476-8a56-336b798cd323 req-8323c6c5-8df3-49a9-b32f-b59dd8a57ae8 service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:17.523275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-6039226b-fe77-4476-8a56-336b798cd323 req-8323c6c5-8df3-49a9-b32f-b59dd8a57ae8 service nova] Creating event network-vif-plugged:b5d61191-2b6c-4044-b457-d2bc922387e8 for instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d on hv-cinder-84614 Jun 20 11:28:17.528519 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-6039226b-fe77-4476-8a56-336b798cd323 req-8323c6c5-8df3-49a9-b32f-b59dd8a57ae8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Jun 20 11:28:17.529129 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 564/1120] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:28:17.611642 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:17.616578 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:17.619313 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:17.620142 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:17.620727 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:17.621158 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:18.077173 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:18.085137 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-301bf05e-7f2f-4d5e-b684-440586a369aa tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.477849 Jun 20 11:28:18.085815 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 557/1121] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:17 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:19.103301 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:19.104008 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:19.111838 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:19.112304 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:19.113092 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:19.113537 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:19.250994 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:19.258964 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-32a44e56-b3f7-4a15-91df-4563cfabd107 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1315 microversion: 2.1 time: 0.160174 Jun 20 11:28:19.259516 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 565/1122] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:19 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:20.276288 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:20.277137 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:20.280843 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=2 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:28:20.281514 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG dbcounter [-] [117606] Writing DB stats nova_cell0:SELECT=6 {{(pid=117606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:28:20.287862 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:20.288310 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:20.289087 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:20.289518 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:20.429799 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:20.437837 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-99ae6fea-5d15-497f-965a-e8629cf82a53 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1465 microversion: 2.1 time: 0.166005 Jun 20 11:28:20.438436 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 558/1123] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:20 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1465 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:20.478793 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:20.479345 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:20.481249 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 11:28:20.487508 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:20.487948 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:20.488706 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:20.489131 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:20.515045 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 11:28:20.591996 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a40d81ce-2eec-4be5-ae11-824672366a4e tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 204 len: 0 microversion: 2.1 time: 0.116768 Jun 20 11:28:20.592844 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 566/1124] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 20 11:28:20 2022] DELETE /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 11:28:20.601996 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:20.602634 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:20.609830 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:20.610314 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:20.611074 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:20.611507 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:20.744796 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.policy [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117606) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:20.752802 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-098dc529-2e8f-4c88-80d0-bfb9c86783e6 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1471 microversion: 2.1 time: 0.154696 Jun 20 11:28:20.753376 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 559/1125] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:20 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:21.773035 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:21.774151 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:21.783010 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:21.783466 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:21.784245 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:21.784685 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:21.929571 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:21.938057 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2593c72e-0398-4ed1-a609-1fd6de27e37a tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1471 microversion: 2.1 time: 0.171880 Jun 20 11:28:21.938746 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 567/1126] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:21 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:22.531631 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [req-1830cf8d-c355-4d6c-ad6c-a4d9273af990 req-f4a003ae-2066-479c-9ab6-ebb77e74bf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c6c1924-71ca-4790-a0f3-b65c6f74140d", "name": "network-vif-deleted", "tag": "b5d61191-2b6c-4044-b457-d2bc922387e8"}]} {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 11:28:22.554411 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-1830cf8d-c355-4d6c-ad6c-a4d9273af990 req-f4a003ae-2066-479c-9ab6-ebb77e74bf5c service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:22.555187 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [req-1830cf8d-c355-4d6c-ad6c-a4d9273af990 req-f4a003ae-2066-479c-9ab6-ebb77e74bf5c service nova] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:22.573696 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.compute.server_external_events [req-1830cf8d-c355-4d6c-ad6c-a4d9273af990 req-f4a003ae-2066-479c-9ab6-ebb77e74bf5c service nova] Creating event network-vif-deleted:b5d61191-2b6c-4044-b457-d2bc922387e8 for instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d on hv-cinder-84614 Jun 20 11:28:22.579401 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [req-1830cf8d-c355-4d6c-ad6c-a4d9273af990 req-f4a003ae-2066-479c-9ab6-ebb77e74bf5c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052183 Jun 20 11:28:22.580526 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 560/1127] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 20 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 11:28:22.956331 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:22.956980 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:22.963604 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:22.964081 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:22.964836 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:22.965275 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:22.999263 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:22.999722 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:23.000177 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lazy-loading 'fault' on Instance uuid 2c6c1924-71ca-4790-a0f3-b65c6f74140d {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 11:28:23.043123 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5b7c9509c8442d829c28380dbcb8a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44bccb33574a441ca04a3da2d1ed1585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 11:28:23.051396 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d6477801-4433-4782-b247-e08644d05836 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 200 len: 1305 microversion: 2.1 time: 0.099062 Jun 20 11:28:23.051961 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 568/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:22 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 11:28:24.069915 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Calling method '>' {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 11:28:24.070628 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.compute.api [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] [instance: 2c6c1924-71ca-4790-a0f3-b65c6f74140d] Fetching instance by UUID {{(pid=117606) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 11:28:24.078557 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:24.079012 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:24.079829 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 11:28:24.080269 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG oslo_concurrency.lockutils [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Lock "ac8d171c-705f-4ce5-ac91-b59b7b5effe3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117606) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 11:28:24.094712 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.wsgi [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] HTTP exception thrown: Instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d could not be found. Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Request method failure captured: Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: request: GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d HTTP/1.1 Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept: application/json Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Accept-Encoding: identity Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Connection: close Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Length: 0 Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Content-Type: application/json Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Host: 10.222.0.33 Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Openstack-System-Scope: None Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: User-Agent: python-urllib3/1.26.9 Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Auth-Token: gAAAAABisFnHzgjieKmgjjbqStisZYrzwPUDQum9KtKnhYrcQZFzYo7jNYaSTKXc4OPbwlC4AXP0iXNMiaxjsPHV7TVJG-v4spbFBTMTKpAMHlf1GjMnWtGpxedLEsHloW268vcELK7XYXVNUTQQ-jmvuDdYZ4mPNW_eBoKnI3ocKq5rzLz2TRw Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Id: None Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Domain-Name: None Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Identity-Status: Confirmed Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Is-Admin-Project: True Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Id: default Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Domain-Name: Default Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Id: 44bccb33574a441ca04a3da2d1ed1585 Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Project-Name: tempest-VolumesNegativeTest-1665048879 Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Role: member,reader Jun 20 11:28:24.096404 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Roles: member,reader Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44bccb33574a441ca04a3da2d1ed1585"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44bccb33574a441ca04a3da2d1ed1585"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44bccb33574a441ca04a3da2d1ed1585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44bccb33574a441ca04a3da2d1ed1585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant: tempest-VolumesNegativeTest-1665048879 Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Id: 44bccb33574a441ca04a3da2d1ed1585 Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-Tenant-Name: tempest-VolumesNegativeTest-1665048879 Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User: tempest-VolumesNegativeTest-1665048879-project Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Id: default Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Domain-Name: Default Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Id: 6d5b7c9509c8442d829c28380dbcb8a7 Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: X-User-Name: tempest-VolumesNegativeTest-1665048879-project Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: method: > Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: exception: Instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d could not be found. Jun 20 11:28:24.098311 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: action_args: {'id': '2c6c1924-71ca-4790-a0f3-b65c6f74140d'} Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: {{(pid=117606) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d could not be found. Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 11:28:24.099388 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d could not be found. Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d could not be found. Jun 20 11:28:24.101067 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: ERROR nova.api.openstack.wsgi Jun 20 11:28:24.102537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: DEBUG nova.api.openstack.wsgi [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] Returning 404 to user: Instance 2c6c1924-71ca-4790-a0f3-b65c6f74140d could not be found. {{(pid=117606) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 11:28:24.102537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO nova.api.openstack.requestlog [None req-586d754e-521a-41d3-b31b-4fa028161a86 tempest-VolumesNegativeTest-1665048879 tempest-VolumesNegativeTest-1665048879-project] 10.222.0.33 "GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d" status: 404 len: 111 microversion: 2.1 time: 0.032289 Jun 20 11:28:24.102537 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: [pid: 117606|app: 0|req: 561/1129] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 20 11:28:24 2022] GET /compute/v2.1/servers/2c6c1924-71ca-4790-a0f3-b65c6f74140d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 11:29:31.015995 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:29:31.016871 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:31:00.574803 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:31:00.575524 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:31:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:31:12.340017 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:31:12.340719 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:31:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:31:22.659157 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:31:22.659918 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:31:30.034011 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:31:30.035253 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:31:40.786903 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:31:40.787563 dv-cinder-846146-3-iscsi devstack@n-api.service[117606]: Mon Jun 20 11:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 11:32:51.029041 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 11:32:51.029688 dv-cinder-846146-3-iscsi devstack@n-api.service[117605]: Mon Jun 20 11:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!